-- Logs begin at Sat 2022-09-17 02:59:30 UTC, end at Sat 2022-09-17 03:53:08 UTC. -- Sep 17 03:22:36.354466 dv-cinder-849143-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 17 03:22:36.363533 dv-cinder-849143-3-smb devstack@keystone.service[81397]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 03:22:36 2022] *** Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: nodename: dv-cinder-849143-3-smb Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: machine: x86_64 Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: clock source: unix Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: pcre jit disabled Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: detected number of CPU cores: 4 Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: current working directory: / Sep 17 03:22:36.365541 dv-cinder-849143-3-smb devstack@keystone.service[81397]: detected binary path: /usr/bin/uwsgi-core Sep 17 03:22:36.366101 dv-cinder-849143-3-smb devstack@keystone.service[81397]: your processes number limit is 47680 Sep 17 03:22:36.366101 dv-cinder-849143-3-smb devstack@keystone.service[81397]: your memory page size is 4096 bytes Sep 17 03:22:36.366101 dv-cinder-849143-3-smb devstack@keystone.service[81397]: detected max file descriptor number: 2048 Sep 17 03:22:36.366101 dv-cinder-849143-3-smb devstack@keystone.service[81397]: lock engine: pthread robust mutexes Sep 17 03:22:36.366101 dv-cinder-849143-3-smb devstack@keystone.service[81397]: thunder lock: enabled Sep 17 03:22:36.366101 dv-cinder-849143-3-smb devstack@keystone.service[81397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 17 03:22:36.366101 dv-cinder-849143-3-smb devstack@keystone.service[81397]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 03:22:36.408997 dv-cinder-849143-3-smb devstack@keystone.service[81397]: Python main interpreter initialized at 0x55db5f2319c0 Sep 17 03:22:36.408997 dv-cinder-849143-3-smb devstack@keystone.service[81397]: python threads support enabled Sep 17 03:22:36.408997 dv-cinder-849143-3-smb devstack@keystone.service[81397]: your server socket listen backlog is limited to 100 connections Sep 17 03:22:36.408997 dv-cinder-849143-3-smb devstack@keystone.service[81397]: your mercy for graceful operations on workers is 90 seconds Sep 17 03:22:36.409338 dv-cinder-849143-3-smb devstack@keystone.service[81397]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 03:22:36.409426 dv-cinder-849143-3-smb devstack@keystone.service[81397]: *** Operational MODE: preforking *** Sep 17 03:22:36.409674 dv-cinder-849143-3-smb devstack@keystone.service[81397]: *** uWSGI is running in multiple interpreter mode *** Sep 17 03:22:36.409674 dv-cinder-849143-3-smb devstack@keystone.service[81397]: spawned uWSGI master process (pid: 81397) Sep 17 03:22:36.409942 dv-cinder-849143-3-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 17 03:22:36.410647 dv-cinder-849143-3-smb devstack@keystone.service[81397]: spawned uWSGI worker 1 (pid: 81408, cores: 1) Sep 17 03:22:36.410754 dv-cinder-849143-3-smb devstack@keystone.service[81397]: spawned uWSGI worker 2 (pid: 81409, cores: 1) Sep 17 03:22:36.410900 dv-cinder-849143-3-smb devstack@keystone.service[81397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 03:22:40.603494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 03:22:40.603494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: from cryptography.utils import int_from_bytes Sep 17 03:22:40.604333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 03:22:40.604333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: from cryptography.utils import int_from_bytes Sep 17 03:22:40.610152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 03:22:40.610152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: from cryptography.utils import int_from_bytes Sep 17 03:22:40.610679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 03:22:40.610679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: from cryptography.utils import int_from_bytes Sep 17 03:22:40.653326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 03:22:40.653510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 03:22:40.653647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] command line args: [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 03:22:40.653966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 03:22:40.654104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ================================================================================ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 03:22:40.654375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] admin_token = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.654612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_dir = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.654810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.654950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] config_source = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.655142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] debug = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.655336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.656681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.656681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.656681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.656681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.656681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.656681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_config_append = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.657027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.657027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_dir = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.657141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 03:22:40.657208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.657404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 03:22:40.657556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.657639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] command line args: [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 03:22:40.657784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.657863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 03:22:40.657991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ================================================================================ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 03:22:40.658147 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] admin_token = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_dir = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] config_source = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.658960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] debug = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.659919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.660038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.660201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.660278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.660391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_config_append = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.660465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.660546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.660660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_dir = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.660868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] publish_errors = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.661941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] standard_threads = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.662949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_journal = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_json = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_stderr = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] use_syslog = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.663924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.664004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.664194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.664368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.664487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.664673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.664863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.664991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] publish_errors = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.665119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.665243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.665450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.665570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.665683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.665816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.665937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.666062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.666185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.666319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.666432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.666545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] standard_threads = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.666663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.666776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.666899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.667019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.667019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.667229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.667343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_journal = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.667455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.667578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_json = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.667698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.667810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_stderr = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.667810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] use_syslog = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.668020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.668132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 03:22:40.668294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.668420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.668541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.668654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.668765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.668876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.668999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.669118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.669231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.669349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.669472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.669589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.669712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.669878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.669993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.670104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.670217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.670328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.670449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.670569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.670682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.670794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.670906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.671023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.671216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.671331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.671450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.671563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.671681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.671801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.671915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.672949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.673066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.673187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.673299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.673299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.673514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.673633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.673765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.673897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.674935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.675971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.676090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.676202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.676320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.676432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.676543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.676732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.676848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.676960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.677072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.677183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.677294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.677414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.677532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.677650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.677811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.677926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.678038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.678166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.678281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.678430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.678552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.678664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.678776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.678897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.679010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.679202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.679328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.679442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.679553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.679673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.679771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.679868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.680946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.681066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.681181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.681293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.681405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.681525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.681639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.681779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.681896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.682905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.683963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684309 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684424 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.684998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.685112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.685236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.685350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.685469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.685583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.685696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.685851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.685974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.686089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.686202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.686315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.686428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.686531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.686651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.686777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.686892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687798 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.687910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.688974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.689188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.689188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.689401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.689513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.external = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.689634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.689770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.689886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.689886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.690098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.690212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.690338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.690454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.690567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.password = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.690679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.690792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] auth.token = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.690905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.691027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.691148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.691303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.691422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.691565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.691690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.691806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.691919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.692955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.693171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.693284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.693409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.693526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.693640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.693798 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.693914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.external = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694271 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.password = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.694983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.695101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] auth.token = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.695101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.695315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.695429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.695550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.695667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.695787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.695902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696369 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.696951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.697066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.697181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.697295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.697409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.697522 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.697644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.697776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.697891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.698840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.699975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.700089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.700203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.700325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.700440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.700553 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.700667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.700780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.700895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.701025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.701141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.701255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.701368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.701481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.701601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.701871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.702056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.702223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.702394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.702555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.702716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.702891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.703052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.703213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.703347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.703464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.703580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.703707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.703823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.703937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.704052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.704172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.704288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.704411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.704603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.704720 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.704835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.704950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.705069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.705194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.705310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.705425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.705539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.705653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.705826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.705958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.706936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.707050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.707171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.707294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.707418 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.707534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.707648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.707761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.707877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708624 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.708984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.709100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.709215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.709337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.709453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.709567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.709680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.709819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.709935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.710986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.711100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.711213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.711328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.711450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.711565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.711679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.711793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.711908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.712951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.713064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.713178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.713292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.713406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.713528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.713643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.713772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.713887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.714944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715757 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.715984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.716097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.716211 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.716333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.716448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.716562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.716676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.716789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.716903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.717995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.718109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.718222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.718335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.718460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.718576 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.718726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.718844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.718958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.719071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.719197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.719313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.719426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.719540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.719662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.719778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.719900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.720939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.721053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.721167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.721288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.721404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.721517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.721631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.721745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.721876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.722002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.722118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.722234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.722348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.722348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.722651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.722779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.722897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723592 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723820 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.723942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.724066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.724181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.724295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.724410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.724524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.724638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.724826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.724946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.725060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.725177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.725299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.725415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.725537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.725653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.725787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.725904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.726949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727522 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.727970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.728085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.728198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.728320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.728435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.728548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.728663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.728817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.728935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.729058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.729174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.729289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.729403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.729516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.729630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.729820 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.729939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730282 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730522 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730761 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.730990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.731112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.731229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.731343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.731343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.731556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.731671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.731792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.731907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.732943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.733057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.733179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.733295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.733410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.733524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.733638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.733777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.733906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.734964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.735079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.735196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.735309 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.735432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.735547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.735661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.735775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.735888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.736932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737625 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.737986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.738149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.738278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.738394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.738509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.738623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.738737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.738883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.739451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.740387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.741310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.741310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.741310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.741310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.741310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 03:22:40.741310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 03:22:40.764937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.765173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.765379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.768007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.768241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.768465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.774023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.776768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.802654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.802868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.803520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.803756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.856462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.860999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.904766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.904960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.907954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:40.908187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.063484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.063698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.063916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.064109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.064239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.064346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.064415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.064599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.064729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.064869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.065009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.065142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.087520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.087651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.087806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.087950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.088965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.089096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.099899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.100028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.112499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.112696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.112861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.112962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.113094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.113094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.113367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.113509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.113591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.113729 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.113907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.114044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81409) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.114177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.114177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 03:22:41.131133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.131277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.131438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 03:22:41.131565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 03:22:41.131690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.131834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.131934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 03:22:41.132140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 03:22:41.132234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.132397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.132488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.132650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.132844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.132981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.133158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.133491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.142784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.143059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.143300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.143606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.143998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.144274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.144609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.144891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.150561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.151836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.153404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.153684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.153985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.154261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.154540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.154741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.154869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.155029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.155114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.155282 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.155409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.155555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.155744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.155834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.155959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.156040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.156114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.156312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.156564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.156834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.157104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.157369 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.179372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.180239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.180847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.181128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.181723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.182035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.185744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.186045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.186322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.186664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.186942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.187222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.192600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.192883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.194197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.194589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.198660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.198947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.199228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.199506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.199779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.200048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.200322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.200574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.202429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.202816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.203186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.203466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.203740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.203981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.204245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.204509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.215864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.216103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.219891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.220019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.220150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.223164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.223452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.223990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.227241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.227536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.227661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.231075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.231723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.234264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.234555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.234840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.235034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.235131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.235394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.235681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.238166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.238538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.238797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.239084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.239372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.239667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.251269 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.251554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.251816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.252071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.255255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.255538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.255811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.256062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.258854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.260370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.262274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.262504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.263191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.264712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.265164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.265451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.265728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.266042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.266261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.266397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.266585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.269153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.269520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.269806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.270116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.270499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.277346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.277626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.277922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.278204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.278583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.278868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.279155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.281490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.281792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.282076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.282351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.282726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.283005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.283291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.294234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.297098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.298493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.300052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.301452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.301580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.303007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.303284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.303676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.304337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.305847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.307264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.307539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.307936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.309950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.311387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.314214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.314341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.314623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.314871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.315173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.315664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.318560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.318956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.319243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.319517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.322898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.323182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.323460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.327249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.327535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.327819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.330211 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.330489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.331028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.331300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.331567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.331842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.332184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.332456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.332732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.333004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.333260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.333626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.333912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.334180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.334665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81409) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 03:22:41.334944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.335220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.335496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.335751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.336019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.336290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.336573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.336843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.337116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.337393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.337670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.337957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.338218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81409) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 03:22:41.367553 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db5f2319c0 pid: 81408 (default app) Sep 17 03:22:41.370810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e4a6a-14c5-4fcf-afc6-88616cab93b7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:41.371096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e4a6a-14c5-4fcf-afc6-88616cab93b7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:41.371361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e4a6a-14c5-4fcf-afc6-88616cab93b7 None None] PATH_INFO: `/v3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:41.371670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55db5f2319c0 pid: 81409 (default app) Sep 17 03:22:41.375516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Sat Sep 17 03:22:41 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:22:48.174692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26f8c-475f-4ee6-9241-e1e28eed40be None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:48.175247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26f8c-475f-4ee6-9241-e1e28eed40be None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:48.175247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f26f8c-475f-4ee6-9241-e1e28eed40be None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:48.179586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:22:48.186188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:48.187160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:48.187160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:48.270928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: INFO dbcounter [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] Registered counter for database keystone Sep 17 03:22:48.291768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG oslo_db.sqlalchemy.engines [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 03:22:48.299790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writer thread running {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 03:22:48.485344 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG passlib.handlers.bcrypt [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81408) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 03:22:48.485730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG passlib.handlers.bcrypt [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81408) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 03:22:48.544691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:48.546294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:48.680612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 17 03:22:49.165299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26f8c-475f-4ee6-9241-e1e28eed40be None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:49.236370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: INFO dbcounter [None req-a8f26f8c-475f-4ee6-9241-e1e28eed40be None None] Registered counter for database keystone Sep 17 03:22:49.261134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG oslo_db.sqlalchemy.engines [None req-a8f26f8c-475f-4ee6-9241-e1e28eed40be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 03:22:49.273239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writer thread running {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 03:22:49.392348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f26f8c-475f-4ee6-9241-e1e28eed40be None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:49.397923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e493f7-4219-482f-b052-86358e6b2e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:49.398547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e493f7-4219-482f-b052-86358e6b2e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:49.398824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e493f7-4219-482f-b052-86358e6b2e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:49.399086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e493f7-4219-482f-b052-86358e6b2e2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:49.407554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e493f7-4219-482f-b052-86358e6b2e2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:49.458466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING keystone.common.rbac_enforcer.enforcer [None req-58e493f7-4219-482f-b052-86358e6b2e2b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 03:22:49.458805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e493f7-4219-482f-b052-86358e6b2e2b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:49.468732 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Sat Sep 17 03:22:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:22:49.475817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:49.499840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84fee0-373b-4433-a8d7-b58611eab1a0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:49.506057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e491321a-7c5a-4d8c-bdca-dd6de0ca11dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:49.507204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491321a-7c5a-4d8c-bdca-dd6de0ca11dd admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:49.507483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491321a-7c5a-4d8c-bdca-dd6de0ca11dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:49.507759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e491321a-7c5a-4d8c-bdca-dd6de0ca11dd admin admin] PATH_INFO: `/v3/projects/04f74c924c074ea694d34911dde51343` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:49.509523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491321a-7c5a-4d8c-bdca-dd6de0ca11dd admin admin] RBAC: Authorizing `identity:get_project(project_id=04f74c924c074ea694d34911dde51343)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:49.561988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e491321a-7c5a-4d8c-bdca-dd6de0ca11dd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 03:22:49.562326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e491321a-7c5a-4d8c-bdca-dd6de0ca11dd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:49.566886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Sat Sep 17 03:22:49 2022] GET /identity/v3/projects/04f74c924c074ea694d34911dde51343 => generated 344 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:22:51.687361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5cc77-0dc1-4835-8f27-e320a2249971 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:51.688010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5cc77-0dc1-4835-8f27-e320a2249971 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:51.688010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f5cc77-0dc1-4835-8f27-e320a2249971 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:51.692005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:22:51.698514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f04a0-ddaf-488b-b100-2f8d2f9eae6d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:51.699242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f04a0-ddaf-488b-b100-2f8d2f9eae6d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:51.699385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f04a0-ddaf-488b-b100-2f8d2f9eae6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:51.724449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a15f04a0-ddaf-488b-b100-2f8d2f9eae6d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:51.726015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a15f04a0-ddaf-488b-b100-2f8d2f9eae6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:51.735970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 17 03:22:51.997391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5cc77-0dc1-4835-8f27-e320a2249971 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:52.012795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f5cc77-0dc1-4835-8f27-e320a2249971 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:52.018200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c75bf0-1a92-4c63-854a-11ee42c2b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:52.018787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75bf0-1a92-4c63-854a-11ee42c2b80f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:52.019060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75bf0-1a92-4c63-854a-11ee42c2b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:52.019329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c75bf0-1a92-4c63-854a-11ee42c2b80f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:52.027809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c75bf0-1a92-4c63-854a-11ee42c2b80f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:52.029584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c75bf0-1a92-4c63-854a-11ee42c2b80f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:52.039148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Sat Sep 17 03:22:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:22:52.045147 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f04a0-ddaf-488b-b100-2f8d2f9eae6d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:52.060175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f04a0-ddaf-488b-b100-2f8d2f9eae6d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:52.069261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73647d-e74e-4317-871d-eeab5a1dc5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:52.069931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73647d-e74e-4317-871d-eeab5a1dc5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:52.070209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73647d-e74e-4317-871d-eeab5a1dc5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:52.070474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73647d-e74e-4317-871d-eeab5a1dc5f4 admin admin] PATH_INFO: `/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:52.072033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73647d-e74e-4317-871d-eeab5a1dc5f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=b2fd6fa62b8a4cbfaf378f47c21f9783)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:52.073931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73647d-e74e-4317-871d-eeab5a1dc5f4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:52.075458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Sat Sep 17 03:22:52 2022] GET /identity/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:22:54.255596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abce7-5d9f-421b-a11d-31da0b063159 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:54.256162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abce7-5d9f-421b-a11d-31da0b063159 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:54.256162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453abce7-5d9f-421b-a11d-31da0b063159 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:54.257446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:22:54.263792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108daca-c4d6-466c-bff8-95963c9284d7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:54.264199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108daca-c4d6-466c-bff8-95963c9284d7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:54.264332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b108daca-c4d6-466c-bff8-95963c9284d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:54.278528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a99a9-8cfc-43b5-977e-d6227f2ed80a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:54.278963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a99a9-8cfc-43b5-977e-d6227f2ed80a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:54.279353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a99a9-8cfc-43b5-977e-d6227f2ed80a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:54.281352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:22:54.287077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b108daca-c4d6-466c-bff8-95963c9284d7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:54.288760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b108daca-c4d6-466c-bff8-95963c9284d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:54.288888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:54.289129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:54.289409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:54.331419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG passlib.handlers.bcrypt [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81409) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 03:22:54.332667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG passlib.handlers.bcrypt [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81409) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 03:22:54.371763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:22:54.380950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:54.382644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:54.483883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:22:54.633437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108daca-c4d6-466c-bff8-95963c9284d7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:54.661003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:54.743449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b108daca-c4d6-466c-bff8-95963c9284d7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:54.748889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:54.777667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73fc36-7cb7-49c5-94ef-6c37ef9646bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:54.778330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73fc36-7cb7-49c5-94ef-6c37ef9646bb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:54.778590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73fc36-7cb7-49c5-94ef-6c37ef9646bb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:54.778858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73fc36-7cb7-49c5-94ef-6c37ef9646bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:54.789797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73fc36-7cb7-49c5-94ef-6c37ef9646bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2c73fc36-7cb7-49c5-94ef-6c37ef9646bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:22:54.798567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:22:54.799659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:22:54.800532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:22:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:22:54.805497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73fc36-7cb7-49c5-94ef-6c37ef9646bb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:54.854909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4450ba-5348-4bd5-b890-5f2b6db89f24 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:54.857173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:54.887752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:54.894483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73736-4f3c-42d4-99d3-69206445e6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:54.895564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73736-4f3c-42d4-99d3-69206445e6aa None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:54.895985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73736-4f3c-42d4-99d3-69206445e6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:54.896264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b73736-4f3c-42d4-99d3-69206445e6aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:54.910511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73fc36-7cb7-49c5-94ef-6c37ef9646bb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:54.945374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:54.946008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:54.946286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:54.946558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:54.947218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:22:54.947511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:54.948912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:54.960641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:22:54.962197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b73736-4f3c-42d4-99d3-69206445e6aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:54.963754 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b73736-4f3c-42d4-99d3-69206445e6aa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:54.966356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:55.062789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:22:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 03:22:55.067710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2dfe7f-b469-47d3-b475-40f05e6d853c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:55.068606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73736-4f3c-42d4-99d3-69206445e6aa None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:55.071361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:55.100112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8940d-aa94-4f85-8208-316810af5bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:55.100803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8940d-aa94-4f85-8208-316810af5bee None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:55.101082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8940d-aa94-4f85-8208-316810af5bee None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:55.101353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c8940d-aa94-4f85-8208-316810af5bee None admin] PATH_INFO: `/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:55.102517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8940d-aa94-4f85-8208-316810af5bee None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd6fa62b8a4cbfaf378f47c21f9783)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:55.104032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c8940d-aa94-4f85-8208-316810af5bee None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:55.105589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:22:54 2022] GET /identity/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:22:55.111097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8940d-aa94-4f85-8208-316810af5bee None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:55.125234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:55.166460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b73736-4f3c-42d4-99d3-69206445e6aa None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:55.198920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:55.199785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:55.200085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:55.200351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:55.208690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c8940d-aa94-4f85-8208-316810af5bee None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:55.218718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:55.220161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:22:55.238050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:22:55.239007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:22:55.239818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:22:55.239818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:22:55.239818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:22:55.239818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:22:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:22:55.241884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1b9e7-ab5c-427b-b89a-cb9d3120e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:55.242524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1b9e7-ab5c-427b-b89a-cb9d3120e483 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:55.242804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1b9e7-ab5c-427b-b89a-cb9d3120e483 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:55.243075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1b9e7-ab5c-427b-b89a-cb9d3120e483 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:55.244188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1b9e7-ab5c-427b-b89a-cb9d3120e483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:55.245109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:55.245640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1b9e7-ab5c-427b-b89a-cb9d3120e483 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:55.247386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:22:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:22:55.252748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1b9e7-ab5c-427b-b89a-cb9d3120e483 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:55.302373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:55.331432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:55.347015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efb928-4443-4bed-9bc0-e647b928fcff None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:55.350041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1b9e7-ab5c-427b-b89a-cb9d3120e483 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:55.379623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380af5a-8768-41e6-a508-9659b7bc07e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:55.380234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380af5a-8768-41e6-a508-9659b7bc07e8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:55.380509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380af5a-8768-41e6-a508-9659b7bc07e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:55.380784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380af5a-8768-41e6-a508-9659b7bc07e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:55.381424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380af5a-8768-41e6-a508-9659b7bc07e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:22:55.381747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380af5a-8768-41e6-a508-9659b7bc07e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:55.383169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380af5a-8768-41e6-a508-9659b7bc07e8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:55.383262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df3a7f-f67e-4e39-b7ab-f19e81b40281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:55.383834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3a7f-f67e-4e39-b7ab-f19e81b40281 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:55.384112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3a7f-f67e-4e39-b7ab-f19e81b40281 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:55.384382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df3a7f-f67e-4e39-b7ab-f19e81b40281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:55.385109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df3a7f-f67e-4e39-b7ab-f19e81b40281 None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.domain.id=default, user.id=b2fd6fa62b8a4cbfaf378f47c21f9783) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:22:55.385415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df3a7f-f67e-4e39-b7ab-f19e81b40281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:55.386924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df3a7f-f67e-4e39-b7ab-f19e81b40281 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:55.394179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Sat Sep 17 03:22:55 2022] GET /identity/v3/role_assignments?user.id=b2fd6fa62b8a4cbfaf378f47c21f9783&scope.domain.id=default&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 233 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:22:55.400790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:22:57.987013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2b269-d756-4ce2-8ec3-05f2b2b6fd3c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:57.987464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2b269-d756-4ce2-8ec3-05f2b2b6fd3c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:57.987554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2b269-d756-4ce2-8ec3-05f2b2b6fd3c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:57.988889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:22:57.994724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd92c6-aff2-4269-8da0-9c56eee4a693 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:57.995161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd92c6-aff2-4269-8da0-9c56eee4a693 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:57.995381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd92c6-aff2-4269-8da0-9c56eee4a693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.021955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-83bd92c6-aff2-4269-8da0-9c56eee4a693 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:58.023475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-83bd92c6-aff2-4269-8da0-9c56eee4a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:58.110400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:22:58.228662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875c2c-240e-4ba7-b460-4cc854ae2315 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:58.229307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875c2c-240e-4ba7-b460-4cc854ae2315 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:58.229812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65875c2c-240e-4ba7-b460-4cc854ae2315 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.231438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:22:58.237039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c941a7-433d-481d-915c-5def364b0af3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:58.237321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c941a7-433d-481d-915c-5def364b0af3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:58.237598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c941a7-433d-481d-915c-5def364b0af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.258778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-54c941a7-433d-481d-915c-5def364b0af3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:58.259989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-54c941a7-433d-481d-915c-5def364b0af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:58.265042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727ea2-f96b-4f7d-9f12-72a0892970b5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:58.265550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727ea2-f96b-4f7d-9f12-72a0892970b5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:58.266059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8727ea2-f96b-4f7d-9f12-72a0892970b5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.267860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 14/25] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:22:58.273526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e059b2-1785-4c02-98f3-02b713dbeebb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:58.274047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e059b2-1785-4c02-98f3-02b713dbeebb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:58.274513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e059b2-1785-4c02-98f3-02b713dbeebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.300453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-23e059b2-1785-4c02-98f3-02b713dbeebb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:58.301664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-23e059b2-1785-4c02-98f3-02b713dbeebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:58.312005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:58.344174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 12/26] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:22:58.380237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82a826-c036-4190-8cc0-716ab17bacda None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:58.380518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82a826-c036-4190-8cc0-716ab17bacda None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:58.380964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e82a826-c036-4190-8cc0-716ab17bacda None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.382529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:22:58.388117 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6669a-406d-40b2-acfb-b6e0102b2fc0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:58.388555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6669a-406d-40b2-acfb-b6e0102b2fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:58.388960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6669a-406d-40b2-acfb-b6e0102b2fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.422102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:22:58.426763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-84f6669a-406d-40b2-acfb-b6e0102b2fc0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:58.430277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-84f6669a-406d-40b2-acfb-b6e0102b2fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:58.495579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 14/29] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:22:58.583957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e059b2-1785-4c02-98f3-02b713dbeebb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:58.672839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:58.704832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e059b2-1785-4c02-98f3-02b713dbeebb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:58.739680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:58.740653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:58.741187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:58.741680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.752847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:58.754727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:58.755336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6669a-406d-40b2-acfb-b6e0102b2fc0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:22:58.778023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:22:58.778945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:22:58.779754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:22:58.779754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:22:58.779754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:22:58.782162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 16/30] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:22:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:22:58.788355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:58.922923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6669a-406d-40b2-acfb-b6e0102b2fc0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:58.934472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:58.959103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d004e30e-a443-4274-a1ca-f639b1bedd24 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:58.964355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701137c-92ee-4d36-92a1-4f7f67615819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:58.965001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701137c-92ee-4d36-92a1-4f7f67615819 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:58.965281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701137c-92ee-4d36-92a1-4f7f67615819 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:58.965556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701137c-92ee-4d36-92a1-4f7f67615819 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:58.977313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701137c-92ee-4d36-92a1-4f7f67615819 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e701137c-92ee-4d36-92a1-4f7f67615819 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:22:58.990091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:22:58.991322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 15/31] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:22:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:22:58.992254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701137c-92ee-4d36-92a1-4f7f67615819 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:58.993098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:59.006501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:59.007374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.007805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.008213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.009005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:22:59.009445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:59.011063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:59.030718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 17/32] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:22:59.036672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:59.104263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701137c-92ee-4d36-92a1-4f7f67615819 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:59.140415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ff5a0-971d-4597-a403-3245b260c56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:59.141272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ff5a0-971d-4597-a403-3245b260c56b None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.141721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ff5a0-971d-4597-a403-3245b260c56b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.142185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ff5a0-971d-4597-a403-3245b260c56b None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.142864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ff5a0-971d-4597-a403-3245b260c56b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:59.144406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ff5a0-971d-4597-a403-3245b260c56b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:59.160823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e0f77-8405-4331-9470-e87c346e69b6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:59.200846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66bcb-184b-4ce2-b547-9e64ca75bb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:59.201462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66bcb-184b-4ce2-b547-9e64ca75bb00 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.201741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66bcb-184b-4ce2-b547-9e64ca75bb00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.202030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab66bcb-184b-4ce2-b547-9e64ca75bb00 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.202764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab66bcb-184b-4ce2-b547-9e64ca75bb00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:59.204150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab66bcb-184b-4ce2-b547-9e64ca75bb00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:59.276775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 16/33] 10.222.0.48 () {60 vars in 1131 bytes} [Sat Sep 17 03:22:58 2022] POST /identity/v3/roles => generated 219 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:22:59.277692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ff5a0-971d-4597-a403-3245b260c56b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:59.338252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:59.372195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 18/34] 10.222.0.48 () {60 vars in 1131 bytes} [Sat Sep 17 03:22:59 2022] POST /identity/v3/roles => generated 225 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:22:59.373197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66bcb-184b-4ce2-b547-9e64ca75bb00 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:59.388382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ff5a0-971d-4597-a403-3245b260c56b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:59.454539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:59.455194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.455488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.455765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.456297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:59.456471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:22:59.456791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:59.458376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:59.486171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 17/35] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:22:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:22:59.486992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:59.523796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab66bcb-184b-4ce2-b547-9e64ca75bb00 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:59.594496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2f874-f2c9-4f33-907e-bd990e3e4695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:59.595603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f874-f2c9-4f33-907e-bd990e3e4695 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.596119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f874-f2c9-4f33-907e-bd990e3e4695 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.596598 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f874-f2c9-4f33-907e-bd990e3e4695 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.597637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2f874-f2c9-4f33-907e-bd990e3e4695 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:59.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2f874-f2c9-4f33-907e-bd990e3e4695 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:59.634836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:59.653796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a731d-b30d-4a4b-a97e-b94a3066e198 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:59.701397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd6ebf-a750-4ec7-8ec4-ed07f2607160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:59.705913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd6ebf-a750-4ec7-8ec4-ed07f2607160 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.705913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd6ebf-a750-4ec7-8ec4-ed07f2607160 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.705913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd6ebf-a750-4ec7-8ec4-ed07f2607160 None admin] PATH_INFO: `/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.709402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd6ebf-a750-4ec7-8ec4-ed07f2607160 None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd6fa62b8a4cbfaf378f47c21f9783)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:59.711165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd6ebf-a750-4ec7-8ec4-ed07f2607160 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:59.717340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 18/36] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:22:59 2022] GET /identity/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783 => generated 247 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:22:59.719330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd6ebf-a750-4ec7-8ec4-ed07f2607160 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:59.807670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 19/37] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:22:59 2022] POST /identity/v3/projects => generated 301 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:22:59.809672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a183-0f54-4643-b309-39031d71daae None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.809989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a183-0f54-4643-b309-39031d71daae None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.810264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864a183-0f54-4643-b309-39031d71daae None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.812120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 20/38] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:22:59.818910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c9d6-84b5-426f-889c-b49e54105915 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.819283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c9d6-84b5-426f-889c-b49e54105915 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.819551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162c9d6-84b5-426f-889c-b49e54105915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.847944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7162c9d6-84b5-426f-889c-b49e54105915 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:22:59.849510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7162c9d6-84b5-426f-889c-b49e54105915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:22:59.899696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd6ebf-a750-4ec7-8ec4-ed07f2607160 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:22:59.940750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77fc9ab-2b40-4753-9b4f-b0f8b81a3478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:22:59.941414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc9ab-2b40-4753-9b4f-b0f8b81a3478 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.941711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc9ab-2b40-4753-9b4f-b0f8b81a3478 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.941994 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77fc9ab-2b40-4753-9b4f-b0f8b81a3478 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.943313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc9ab-2b40-4753-9b4f-b0f8b81a3478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:22:59.944852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77fc9ab-2b40-4753-9b4f-b0f8b81a3478 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:22:59.946539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 19/39] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:22:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:22:59.947990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9c3c4-1ede-4f79-b76b-6ee345ea1ee2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.948277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9c3c4-1ede-4f79-b76b-6ee345ea1ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.948552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff9c3c4-1ede-4f79-b76b-6ee345ea1ee2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.949931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 20/40] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:22:59.952536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9c3c4-1ede-4f79-b76b-6ee345ea1ee2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:22:59.959571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 21/41] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:22:59.961300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049671-b555-4635-bdd9-17e13748c638 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:22:59.961591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049671-b555-4635-bdd9-17e13748c638 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:22:59.961920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb049671-b555-4635-bdd9-17e13748c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:22:59.992660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:22:59.999191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cb049671-b555-4635-bdd9-17e13748c638 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:00.001096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cb049671-b555-4635-bdd9-17e13748c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:00.033036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:00.089864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff9c3c4-1ede-4f79-b76b-6ee345ea1ee2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:00.097373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 22/42] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:00.127084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4509c3-7fd9-4f52-99d6-238af2df885f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:00.127751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4509c3-7fd9-4f52-99d6-238af2df885f None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:00.128102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4509c3-7fd9-4f52-99d6-238af2df885f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:00.128447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4509c3-7fd9-4f52-99d6-238af2df885f None admin] PATH_INFO: `/v3/domains/default/users/b2fd6fa62b8a4cbfaf378f47c21f9783/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:00.130531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4509c3-7fd9-4f52-99d6-238af2df885f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b2fd6fa62b8a4cbfaf378f47c21f9783, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:00.132341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4509c3-7fd9-4f52-99d6-238af2df885f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:00.151236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1361 bytes} [Sat Sep 17 03:22:59 2022] PUT /identity/v3/domains/default/users/b2fd6fa62b8a4cbfaf378f47c21f9783/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:23:00.221926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb049671-b555-4635-bdd9-17e13748c638 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:00.330872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb049671-b555-4635-bdd9-17e13748c638 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:00.366809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9fb49-b348-4684-a43c-0300ea04cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:00.367453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9fb49-b348-4684-a43c-0300ea04cb39 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:00.367736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9fb49-b348-4684-a43c-0300ea04cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:00.368003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9fb49-b348-4684-a43c-0300ea04cb39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:00.369162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9fb49-b348-4684-a43c-0300ea04cb39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:00.370672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee9fb49-b348-4684-a43c-0300ea04cb39 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:00.372168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4509c3-7fd9-4f52-99d6-238af2df885f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:00.372324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 23/44] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:00.377611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9fb49-b348-4684-a43c-0300ea04cb39 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:00.405714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:00.463419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:00.481455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9fb49-b348-4684-a43c-0300ea04cb39 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:00.482018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4509c3-7fd9-4f52-99d6-238af2df885f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:00.519468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad76308-197b-4efe-ac9d-a097b2ab0d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:00.520090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76308-197b-4efe-ac9d-a097b2ab0d13 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:00.520376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76308-197b-4efe-ac9d-a097b2ab0d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:00.520652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76308-197b-4efe-ac9d-a097b2ab0d13 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:00.521348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad76308-197b-4efe-ac9d-a097b2ab0d13 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:00.521790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7da076-75d1-4d97-aabb-2a0ae2a9180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:00.522496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da076-75d1-4d97-aabb-2a0ae2a9180d None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:00.522783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da076-75d1-4d97-aabb-2a0ae2a9180d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:00.522928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad76308-197b-4efe-ac9d-a097b2ab0d13 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:00.523069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7da076-75d1-4d97-aabb-2a0ae2a9180d None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:00.523713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da076-75d1-4d97-aabb-2a0ae2a9180d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:00.525161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7da076-75d1-4d97-aabb-2a0ae2a9180d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:00.540157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1131 bytes} [Sat Sep 17 03:23:00 2022] POST /identity/v3/roles => generated 223 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:23:00.555535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:23:00 2022] POST /identity/v3/projects => generated 312 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:23:02.338109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bece25-01df-4127-bdb8-8b03defd217f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:02.338611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bece25-01df-4127-bdb8-8b03defd217f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:02.338611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bece25-01df-4127-bdb8-8b03defd217f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:02.339928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 23/47] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:02.345332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe69b9-7997-4106-83e2-0f82f6d58a53 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:02.345798 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe69b9-7997-4106-83e2-0f82f6d58a53 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:02.345881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe69b9-7997-4106-83e2-0f82f6d58a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:02.364721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4bbe69b9-7997-4106-83e2-0f82f6d58a53 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:02.365960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4bbe69b9-7997-4106-83e2-0f82f6d58a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:02.434638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:02.696446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a311c-977b-450f-9657-f8bd51674e9a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:02.696688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a311c-977b-450f-9657-f8bd51674e9a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:02.696992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a311c-977b-450f-9657-f8bd51674e9a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:02.698516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 24/49] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:02.704056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8ba9-ca30-48b4-ae35-6f8ecc4c9e0c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:02.704416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8ba9-ca30-48b4-ae35-6f8ecc4c9e0c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:02.704777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4a8ba9-ca30-48b4-ae35-6f8ecc4c9e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:02.709632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a311c-977b-450f-9657-f8bd51674e9a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:02.723502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cf4a8ba9-ca30-48b4-ae35-6f8ecc4c9e0c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:02.724693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf4a8ba9-ca30-48b4-ae35-6f8ecc4c9e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:02.727065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:02.793071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 26/50] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:02.813503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a311c-977b-450f-9657-f8bd51674e9a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:02.848405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939882-d6ff-43cf-8433-f59412406a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:02.849024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939882-d6ff-43cf-8433-f59412406a61 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:02.849303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939882-d6ff-43cf-8433-f59412406a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:02.849574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7939882-d6ff-43cf-8433-f59412406a61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:02.860770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7939882-d6ff-43cf-8433-f59412406a61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a7939882-d6ff-43cf-8433-f59412406a61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:02.865604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:02.866766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:02.867612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 25/51] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:02.872748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8ba9-ca30-48b4-ae35-6f8ecc4c9e0c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:02.975443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4a8ba9-ca30-48b4-ae35-6f8ecc4c9e0c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:03.014645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:03.015263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:03.015550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:03.015824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:03.016497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:03.016983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:03.018237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:03.023417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:03.027777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 27/52] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:03.033565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939882-d6ff-43cf-8433-f59412406a61 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:03.037498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:03.057000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:03.135654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7939882-d6ff-43cf-8433-f59412406a61 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:03.156130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c640f-5071-402e-8477-1bd92832a309 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:03.169817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e9cc-2f50-4b8a-9eaf-599451c89f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:03.170450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e9cc-2f50-4b8a-9eaf-599451c89f7c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:03.170733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e9cc-2f50-4b8a-9eaf-599451c89f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:03.171003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288e9cc-2f50-4b8a-9eaf-599451c89f7c None admin] PATH_INFO: `/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:03.172156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e9cc-2f50-4b8a-9eaf-599451c89f7c None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd6fa62b8a4cbfaf378f47c21f9783)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:03.173630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288e9cc-2f50-4b8a-9eaf-599451c89f7c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:03.175244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:03 2022] GET /identity/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:03.180643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e9cc-2f50-4b8a-9eaf-599451c89f7c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:03.189106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db5f17-3003-4864-bd7d-d885daad0824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:03.189760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db5f17-3003-4864-bd7d-d885daad0824 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:03.190047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db5f17-3003-4864-bd7d-d885daad0824 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:03.190317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db5f17-3003-4864-bd7d-d885daad0824 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:03.191450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db5f17-3003-4864-bd7d-d885daad0824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:03.192936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db5f17-3003-4864-bd7d-d885daad0824 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:03.194688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:03.200105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db5f17-3003-4864-bd7d-d885daad0824 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:03.252860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:03.266448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:03.304808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db5f17-3003-4864-bd7d-d885daad0824 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:03.343510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b4f8c-2a5f-4eef-bb50-b161c86f8bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:03.344159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b4f8c-2a5f-4eef-bb50-b161c86f8bbc None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:03.344443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b4f8c-2a5f-4eef-bb50-b161c86f8bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:03.344715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894b4f8c-2a5f-4eef-bb50-b161c86f8bbc None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:03.345395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b4f8c-2a5f-4eef-bb50-b161c86f8bbc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:03.346948 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894b4f8c-2a5f-4eef-bb50-b161c86f8bbc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:03.389808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 29/55] 10.222.0.48 () {60 vars in 1140 bytes} [Sat Sep 17 03:23:03 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:03.399256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288e9cc-2f50-4b8a-9eaf-599451c89f7c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:03.437371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a663c71-6580-447e-866c-9c3fe1772e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:03.438050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663c71-6580-447e-866c-9c3fe1772e66 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:03.438329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663c71-6580-447e-866c-9c3fe1772e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:03.438632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a663c71-6580-447e-866c-9c3fe1772e66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:03.439881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a663c71-6580-447e-866c-9c3fe1772e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:03.441401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a663c71-6580-447e-866c-9c3fe1772e66 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:03.443112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 27/56] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:03.449317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b4f8c-2a5f-4eef-bb50-b161c86f8bbc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:03.560606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894b4f8c-2a5f-4eef-bb50-b161c86f8bbc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:03.580441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:03.595805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3422728-ec66-4eff-925b-ed6fddba618f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:03.596422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3422728-ec66-4eff-925b-ed6fddba618f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:03.596702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3422728-ec66-4eff-925b-ed6fddba618f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:03.596972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3422728-ec66-4eff-925b-ed6fddba618f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:03.597700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3422728-ec66-4eff-925b-ed6fddba618f None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.domain.id=default, user.id=b2fd6fa62b8a4cbfaf378f47c21f9783) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:03.598050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3422728-ec66-4eff-925b-ed6fddba618f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:03.599510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3422728-ec66-4eff-925b-ed6fddba618f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:03.605449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 30/57] 10.222.0.48 () {56 vars in 1322 bytes} [Sat Sep 17 03:23:03 2022] GET /identity/v3/role_assignments?user.id=b2fd6fa62b8a4cbfaf378f47c21f9783&scope.domain.id=default&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 530 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:05.522548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc31108-24d3-4707-b934-0d52a5780db9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:05.523101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc31108-24d3-4707-b934-0d52a5780db9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:05.523101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc31108-24d3-4707-b934-0d52a5780db9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:05.524510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 28/58] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:05.531119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b5953-3e1d-4aa1-816a-0d74f31b9ed7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:05.531829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b5953-3e1d-4aa1-816a-0d74f31b9ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:05.532021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b5953-3e1d-4aa1-816a-0d74f31b9ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:05.554858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9b0b5953-3e1d-4aa1-816a-0d74f31b9ed7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:05.556048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9b0b5953-3e1d-4aa1-816a-0d74f31b9ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:05.627014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 31/59] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:05.896179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc31108-24d3-4707-b934-0d52a5780db9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:06.004642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc31108-24d3-4707-b934-0d52a5780db9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:06.040153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba5030e-6881-4f23-9c7f-7f53ed1d86b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:06.040777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5030e-6881-4f23-9c7f-7f53ed1d86b2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:06.041055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5030e-6881-4f23-9c7f-7f53ed1d86b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:06.041331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba5030e-6881-4f23-9c7f-7f53ed1d86b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:06.042557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5030e-6881-4f23-9c7f-7f53ed1d86b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:06.044010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba5030e-6881-4f23-9c7f-7f53ed1d86b2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:06.045585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 29/60] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:06.051572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b5953-3e1d-4aa1-816a-0d74f31b9ed7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:06.154864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b5953-3e1d-4aa1-816a-0d74f31b9ed7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:06.168506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:06.191496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfeae21-60ca-4cb9-96f1-d7dced926de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:06.192095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeae21-60ca-4cb9-96f1-d7dced926de2 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:06.192373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeae21-60ca-4cb9-96f1-d7dced926de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:06.192643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfeae21-60ca-4cb9-96f1-d7dced926de2 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:06.193298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeae21-60ca-4cb9-96f1-d7dced926de2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:06.194926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfeae21-60ca-4cb9-96f1-d7dced926de2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:06.222627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 32/61] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:23:06 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:09.478696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beee94-58f4-4941-854b-488b3f7576c1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:09.479747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beee94-58f4-4941-854b-488b3f7576c1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:09.480246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6beee94-58f4-4941-854b-488b3f7576c1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:09.481838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 30/62] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:09.487391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aee790-cf4e-4df7-87dc-5890c668a428 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:09.487811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aee790-cf4e-4df7-87dc-5890c668a428 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:09.487982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aee790-cf4e-4df7-87dc-5890c668a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:09.510888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-39aee790-cf4e-4df7-87dc-5890c668a428 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:09.512107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-39aee790-cf4e-4df7-87dc-5890c668a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:09.525929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398add-b831-42b6-add4-84f4becdee08 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:09.526528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398add-b831-42b6-add4-84f4becdee08 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:09.527283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c398add-b831-42b6-add4-84f4becdee08 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:09.529629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:09.534433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c815dd-42db-4c53-af56-0bed3a110ae8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:09.534963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c815dd-42db-4c53-af56-0bed3a110ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:09.535489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c815dd-42db-4c53-af56-0bed3a110ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:09.566486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a0c815dd-42db-4c53-af56-0bed3a110ae8 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:09.568741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a0c815dd-42db-4c53-af56-0bed3a110ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:09.574079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:09.594853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 33/64] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:09.663074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:09.917518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47cdd-3ed6-463c-8fe2-71ed1f34b6a0 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:09.918249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47cdd-3ed6-463c-8fe2-71ed1f34b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:09.918746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab47cdd-3ed6-463c-8fe2-71ed1f34b6a0 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:09.920788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 34/66] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:09.927039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f4cdc-6899-49c5-9bd7-e0e2a1df50ec None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:09.927667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f4cdc-6899-49c5-9bd7-e0e2a1df50ec None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:09.928129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f4cdc-6899-49c5-9bd7-e0e2a1df50ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:09.947599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-146f4cdc-6899-49c5-9bd7-e0e2a1df50ec None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:09.949125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-146f4cdc-6899-49c5-9bd7-e0e2a1df50ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:09.995374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab47cdd-3ed6-463c-8fe2-71ed1f34b6a0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.067678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 33/67] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:10.068368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f4cdc-6899-49c5-9bd7-e0e2a1df50ec None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.126801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:10.130873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab47cdd-3ed6-463c-8fe2-71ed1f34b6a0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.139307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:10.166541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db80bf7-df14-4c7a-b63d-7a24c096ec25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.167182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db80bf7-df14-4c7a-b63d-7a24c096ec25 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.167463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db80bf7-df14-4c7a-b63d-7a24c096ec25 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.167794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db80bf7-df14-4c7a-b63d-7a24c096ec25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.175438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f4cdc-6899-49c5-9bd7-e0e2a1df50ec None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.177664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db80bf7-df14-4c7a-b63d-7a24c096ec25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2db80bf7-df14-4c7a-b63d-7a24c096ec25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:10.182614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:10.183498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:10.184274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 35/68] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:23:10.185386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaaf11-b503-4da0-ba96-ef4a204fba8f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.186006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaaf11-b503-4da0-ba96-ef4a204fba8f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.186006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eaaf11-b503-4da0-ba96-ef4a204fba8f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.191923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 36/69] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:10.191923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611744-2a20-4d90-85e3-3ac2e71d5e7e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.191923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611744-2a20-4d90-85e3-3ac2e71d5e7e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.191923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2611744-2a20-4d90-85e3-3ac2e71d5e7e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.191923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 37/70] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:10.192266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611744-2a20-4d90-85e3-3ac2e71d5e7e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.219996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cdc9af-751b-403a-a8a8-f0463d1f2015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.220743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdc9af-751b-403a-a8a8-f0463d1f2015 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.221025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdc9af-751b-403a-a8a8-f0463d1f2015 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.221414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cdc9af-751b-403a-a8a8-f0463d1f2015 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.232599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cdc9af-751b-403a-a8a8-f0463d1f2015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a5cdc9af-751b-403a-a8a8-f0463d1f2015 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:10.237677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:10.238708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:10.239654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:10.241971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 34/71] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:10.243844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2541375-c163-4f03-8a86-84deb7b6f452 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.244272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2541375-c163-4f03-8a86-84deb7b6f452 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.244670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2541375-c163-4f03-8a86-84deb7b6f452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.262979 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e2541375-c163-4f03-8a86-84deb7b6f452 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:10.264773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e2541375-c163-4f03-8a86-84deb7b6f452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:10.297453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2611744-2a20-4d90-85e3-3ac2e71d5e7e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.341783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 35/72] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:10.341783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edfaca-5f8b-4183-9327-c7f038ea4b16 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.341783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edfaca-5f8b-4183-9327-c7f038ea4b16 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.341783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edfaca-5f8b-4183-9327-c7f038ea4b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.345418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.346160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.346503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.346992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.347828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:10.347828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:10.349217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:10.357792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-51edfaca-5f8b-4183-9327-c7f038ea4b16 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:10.358261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 38/73] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:10.358758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.363654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-51edfaca-5f8b-4183-9327-c7f038ea4b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:10.383258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:10.420167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:10.435332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 36/74] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:10.436497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edfaca-5f8b-4183-9327-c7f038ea4b16 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.480803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d85788-86d5-45f2-8b9f-c65cc68feb34 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.526435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.527088 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.527461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.527803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.528815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:10.529188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:10.531263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:10.542229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 39/75] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:10.544006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.546798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edfaca-5f8b-4183-9327-c7f038ea4b16 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.587553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337874-6275-4b0e-8fbb-99b6d4b1610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.588464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337874-6275-4b0e-8fbb-99b6d4b1610e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.588844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337874-6275-4b0e-8fbb-99b6d4b1610e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.589240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03337874-6275-4b0e-8fbb-99b6d4b1610e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.600375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03337874-6275-4b0e-8fbb-99b6d4b1610e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-03337874-6275-4b0e-8fbb-99b6d4b1610e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:10.605323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:10.606204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:10.606964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 37/76] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:10.607585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337874-6275-4b0e-8fbb-99b6d4b1610e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.636686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:10.653527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc8f1-7633-49ff-b41f-bd6275554431 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.669168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:10.692791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f756f5-1cb0-44f7-ad1d-4e1a2a0854ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.693400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f756f5-1cb0-44f7-ad1d-4e1a2a0854ad None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.693683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f756f5-1cb0-44f7-ad1d-4e1a2a0854ad None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.693985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f756f5-1cb0-44f7-ad1d-4e1a2a0854ad None admin] PATH_INFO: `/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.695223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f756f5-1cb0-44f7-ad1d-4e1a2a0854ad None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd6fa62b8a4cbfaf378f47c21f9783)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:10.697189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f756f5-1cb0-44f7-ad1d-4e1a2a0854ad None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:10.704371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 40/77] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:10.704371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f756f5-1cb0-44f7-ad1d-4e1a2a0854ad None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.721070 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03337874-6275-4b0e-8fbb-99b6d4b1610e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.755177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c94e1-5435-4316-a6c2-c3a6fa7f6717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.755803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c94e1-5435-4316-a6c2-c3a6fa7f6717 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.756082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c94e1-5435-4316-a6c2-c3a6fa7f6717 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.756354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c94e1-5435-4316-a6c2-c3a6fa7f6717 None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.771149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c94e1-5435-4316-a6c2-c3a6fa7f6717 None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:10.772587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c94e1-5435-4316-a6c2-c3a6fa7f6717 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:10.774301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 38/78] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:10.775071 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c94e1-5435-4316-a6c2-c3a6fa7f6717 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.802828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f756f5-1cb0-44f7-ad1d-4e1a2a0854ad None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.835471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a169-bb14-477d-bbe2-6b252ef10216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.836108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a169-bb14-477d-bbe2-6b252ef10216 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.836390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a169-bb14-477d-bbe2-6b252ef10216 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.836661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59a169-bb14-477d-bbe2-6b252ef10216 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.847140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59a169-bb14-477d-bbe2-6b252ef10216 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0a59a169-bb14-477d-bbe2-6b252ef10216 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:10.852478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:10.853366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:10.854177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 41/79] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:10.854827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a169-bb14-477d-bbe2-6b252ef10216 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.870036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:10.873657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c94e1-5435-4316-a6c2-c3a6fa7f6717 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.881534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:10.908015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.908644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.908907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.909174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:10.909877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:10.910178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:10.911568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:10.919334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 39/80] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:10.920154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:10.958296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59a169-bb14-477d-bbe2-6b252ef10216 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:10.993703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82816ed-92ce-4e4c-9856-91ec98edd8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:10.994364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82816ed-92ce-4e4c-9856-91ec98edd8da None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:10.994641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82816ed-92ce-4e4c-9856-91ec98edd8da None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:10.994910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82816ed-92ce-4e4c-9856-91ec98edd8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.021077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd6ce-4a41-4afb-bec1-319a2a6c3eb4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.054897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3301a0-7e78-4533-9551-e8a84348971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.055516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3301a0-7e78-4533-9551-e8a84348971f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.055796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3301a0-7e78-4533-9551-e8a84348971f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.056057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3301a0-7e78-4533-9551-e8a84348971f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.057228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3301a0-7e78-4533-9551-e8a84348971f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.058703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3301a0-7e78-4533-9551-e8a84348971f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.060279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:11.062473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82816ed-92ce-4e4c-9856-91ec98edd8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.063932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82816ed-92ce-4e4c-9856-91ec98edd8da None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.065578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3301a0-7e78-4533-9551-e8a84348971f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.077218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:11.098724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:11.160015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 42/82] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:11.160651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82816ed-92ce-4e4c-9856-91ec98edd8da None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.166406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3301a0-7e78-4533-9551-e8a84348971f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.200056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099dfb-d9cc-482d-b84c-aeeb671287b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.200667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099dfb-d9cc-482d-b84c-aeeb671287b3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.200947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099dfb-d9cc-482d-b84c-aeeb671287b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.201222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6099dfb-d9cc-482d-b84c-aeeb671287b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.256836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82816ed-92ce-4e4c-9856-91ec98edd8da None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.267441 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6099dfb-d9cc-482d-b84c-aeeb671287b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.268902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6099dfb-d9cc-482d-b84c-aeeb671287b3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.270418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:11.291267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.291871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.292146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.292414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.293067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:11.293362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.294800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.302634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 43/83] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:11.303414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.308065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:11.368953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:11.373738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099dfb-d9cc-482d-b84c-aeeb671287b3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.406389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e9f54-ad25-4daf-8245-95a8aab758ac None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.438625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f04e7-dc4f-46fd-83ce-fdb2fa39ea4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.439255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f04e7-dc4f-46fd-83ce-fdb2fa39ea4e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.439535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f04e7-dc4f-46fd-83ce-fdb2fa39ea4e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.439816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f04e7-dc4f-46fd-83ce-fdb2fa39ea4e None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.440962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f04e7-dc4f-46fd-83ce-fdb2fa39ea4e None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.442449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f04e7-dc4f-46fd-83ce-fdb2fa39ea4e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.444032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 44/85] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:11.444896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f04e7-dc4f-46fd-83ce-fdb2fa39ea4e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.473330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6099dfb-d9cc-482d-b84c-aeeb671287b3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.486463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:11.506712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cbd0b-6d5e-45ed-ba4f-e824ddbb3ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.507470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbd0b-6d5e-45ed-ba4f-e824ddbb3ee2 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.507701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbd0b-6d5e-45ed-ba4f-e824ddbb3ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.507974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cbd0b-6d5e-45ed-ba4f-e824ddbb3ee2 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.508636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cbd0b-6d5e-45ed-ba4f-e824ddbb3ee2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.510131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cbd0b-6d5e-45ed-ba4f-e824ddbb3ee2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.523486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:11.538459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 42/86] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:23:11 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:11.542783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cbd0b-6d5e-45ed-ba4f-e824ddbb3ee2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.544402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f04e7-dc4f-46fd-83ce-fdb2fa39ea4e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.585232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6e9a-1e60-4c29-98f7-291876acb94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.585917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6e9a-1e60-4c29-98f7-291876acb94a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.586200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6e9a-1e60-4c29-98f7-291876acb94a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.586475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3f6e9a-1e60-4c29-98f7-291876acb94a None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.587682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f6e9a-1e60-4c29-98f7-291876acb94a None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.589198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3f6e9a-1e60-4c29-98f7-291876acb94a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.590984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 45/87] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:11.591806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6e9a-1e60-4c29-98f7-291876acb94a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.671540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cbd0b-6d5e-45ed-ba4f-e824ddbb3ee2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.705945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3f6e9a-1e60-4c29-98f7-291876acb94a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.711312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c5d2-389f-42f3-8ac9-d832af3bba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.711954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c5d2-389f-42f3-8ac9-d832af3bba8d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.712233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c5d2-389f-42f3-8ac9-d832af3bba8d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.712505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25c5d2-389f-42f3-8ac9-d832af3bba8d None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.713709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25c5d2-389f-42f3-8ac9-d832af3bba8d None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.715196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25c5d2-389f-42f3-8ac9-d832af3bba8d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.716799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 43/88] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:11.717580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c5d2-389f-42f3-8ac9-d832af3bba8d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.719332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:11.746904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac1c82-197a-406d-93df-a26b41a129c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.747558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac1c82-197a-406d-93df-a26b41a129c8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.747834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac1c82-197a-406d-93df-a26b41a129c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.748761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac1c82-197a-406d-93df-a26b41a129c8 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.750204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac1c82-197a-406d-93df-a26b41a129c8 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.751970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac1c82-197a-406d-93df-a26b41a129c8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.755119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 46/89] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:11.755119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac1c82-197a-406d-93df-a26b41a129c8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.789091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:11.840094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25c5d2-389f-42f3-8ac9-d832af3bba8d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.871966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac1c82-197a-406d-93df-a26b41a129c8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:11.878698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c5868-49f1-4440-894c-74f1a5038851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.879706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c5868-49f1-4440-894c-74f1a5038851 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.880157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c5868-49f1-4440-894c-74f1a5038851 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.880601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c5868-49f1-4440-894c-74f1a5038851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.909604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:11.910248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:11.910526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:11.910796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:11.911526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8, user.id=b2fd6fa62b8a4cbfaf378f47c21f9783) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:11.911835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.913286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.920924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 47/90] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/role_assignments?user.id=b2fd6fa62b8a4cbfaf378f47c21f9783&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:11.921908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:11.967611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c5868-49f1-4440-894c-74f1a5038851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:11.969594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c5868-49f1-4440-894c-74f1a5038851 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:11.977533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:12.063777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:12.072563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03b28ed-8208-41a0-ac8e-572c8172fcaa None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:12.112174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 44/91] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:12.113630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c5868-49f1-4440-894c-74f1a5038851 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:12.146291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d8f4c-750d-4f3b-8ce1-9b801b34d621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:12.146923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d8f4c-750d-4f3b-8ce1-9b801b34d621 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:12.147232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d8f4c-750d-4f3b-8ce1-9b801b34d621 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:12.147581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d8f4c-750d-4f3b-8ce1-9b801b34d621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:12.253078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d8f4c-750d-4f3b-8ce1-9b801b34d621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:12.254595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d8f4c-750d-4f3b-8ce1-9b801b34d621 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:12.270850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c5868-49f1-4440-894c-74f1a5038851 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:12.299821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:12.312708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:12.313334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:12.313613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:12.313978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:12.314714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] RBAC: Adding query filter params (role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8, user.id=f8365201de5f41589d4628aa197e5aae) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:12.315028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:12.316522 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:12.326765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 45/92] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:12 2022] GET /identity/v3/role_assignments?user.id=f8365201de5f41589d4628aa197e5aae&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=d907003acd2748ac99d722b1aea4288a => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:12.327713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:12.367558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:12.414025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 48/93] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:12.421637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d8f4c-750d-4f3b-8ce1-9b801b34d621 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:12.543999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2445e-3470-4bbb-b5c8-9b38b3e7e025 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:12.581623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f6152-291e-4a45-8151-e789fdaa7581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:12.582800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6152-291e-4a45-8151-e789fdaa7581 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:12.583292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6152-291e-4a45-8151-e789fdaa7581 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:12.583751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f6152-291e-4a45-8151-e789fdaa7581 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:12.586093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f6152-291e-4a45-8151-e789fdaa7581 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:12.587952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f6152-291e-4a45-8151-e789fdaa7581 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:12.589999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 46/94] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:12 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:12.597575 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f6152-291e-4a45-8151-e789fdaa7581 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:12.647841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d8f4c-750d-4f3b-8ce1-9b801b34d621 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:12.719722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44829166-8150-4b2b-8bcd-d0f0634e8211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:12.720474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44829166-8150-4b2b-8bcd-d0f0634e8211 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:12.720664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44829166-8150-4b2b-8bcd-d0f0634e8211 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:12.720942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44829166-8150-4b2b-8bcd-d0f0634e8211 None admin] PATH_INFO: `/v3/projects/0a7642486a6f48fca5297d721aa8e08e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:12.723458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44829166-8150-4b2b-8bcd-d0f0634e8211 None admin] RBAC: Authorizing `identity:get_project(project_id=0a7642486a6f48fca5297d721aa8e08e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:12.725057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44829166-8150-4b2b-8bcd-d0f0634e8211 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:12.727135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 49/95] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:12 2022] GET /identity/v3/projects/0a7642486a6f48fca5297d721aa8e08e => generated 312 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:12.732644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44829166-8150-4b2b-8bcd-d0f0634e8211 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:12.735664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:12.746383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f6152-291e-4a45-8151-e789fdaa7581 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:12.757798 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:12.782562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa6a61-9a73-46fc-8616-e9acc3517590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:12.783532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6a61-9a73-46fc-8616-e9acc3517590 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:12.783999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6a61-9a73-46fc-8616-e9acc3517590 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:12.784458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa6a61-9a73-46fc-8616-e9acc3517590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:12.785371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6a61-9a73-46fc-8616-e9acc3517590 None admin] RBAC: Adding query filter params (role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8, user.id=f8365201de5f41589d4628aa197e5aae) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:12.785922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6a61-9a73-46fc-8616-e9acc3517590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:12.787569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa6a61-9a73-46fc-8616-e9acc3517590 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:12.793739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 47/96] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:12 2022] GET /identity/v3/role_assignments?user.id=f8365201de5f41589d4628aa197e5aae&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=caea830f617d461ca08b1b747e2500a1 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:12.880217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44829166-8150-4b2b-8bcd-d0f0634e8211 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:12.917939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5759b144-46e7-47f6-ba8c-51c957e0236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:12.918969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b144-46e7-47f6-ba8c-51c957e0236e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:12.919463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b144-46e7-47f6-ba8c-51c957e0236e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:12.919923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5759b144-46e7-47f6-ba8c-51c957e0236e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:12.920886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759b144-46e7-47f6-ba8c-51c957e0236e None admin] RBAC: Adding query filter params (role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=0a7642486a6f48fca5297d721aa8e08e, user.id=f8365201de5f41589d4628aa197e5aae) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:12.921453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759b144-46e7-47f6-ba8c-51c957e0236e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:12.923175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5759b144-46e7-47f6-ba8c-51c957e0236e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:12.929940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 50/97] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:12 2022] GET /identity/v3/role_assignments?user.id=f8365201de5f41589d4628aa197e5aae&scope.project.id=0a7642486a6f48fca5297d721aa8e08e&role.id=d907003acd2748ac99d722b1aea4288a => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:14.151498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bc999-6526-4402-8b1c-016061ca3990 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:14.152555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bc999-6526-4402-8b1c-016061ca3990 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:14.153074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513bc999-6526-4402-8b1c-016061ca3990 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:14.154641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 48/98] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:14.160039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079d07-ba97-4782-9b93-863d56760562 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:14.160826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079d07-ba97-4782-9b93-863d56760562 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:14.161291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73079d07-ba97-4782-9b93-863d56760562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:14.183944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-73079d07-ba97-4782-9b93-863d56760562 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:14.185439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-73079d07-ba97-4782-9b93-863d56760562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:14.282284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:14.807827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bc999-6526-4402-8b1c-016061ca3990 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:14.936844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513bc999-6526-4402-8b1c-016061ca3990 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:14.989203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a16d-5419-4ff9-9076-3b413afdca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:14.989938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a16d-5419-4ff9-9076-3b413afdca79 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:14.990229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a16d-5419-4ff9-9076-3b413afdca79 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:14.990503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a16d-5419-4ff9-9076-3b413afdca79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.022644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120a16d-5419-4ff9-9076-3b413afdca79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6120a16d-5419-4ff9-9076-3b413afdca79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:15.027578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:15.028425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:15.029195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 49/100] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:15.037343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73079d07-ba97-4782-9b93-863d56760562 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:15.040942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:15.201827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73079d07-ba97-4782-9b93-863d56760562 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:15.252825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf825a-c565-46ab-b17e-cc1962c58bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:15.253465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf825a-c565-46ab-b17e-cc1962c58bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.253744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf825a-c565-46ab-b17e-cc1962c58bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.254044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf825a-c565-46ab-b17e-cc1962c58bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.254723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf825a-c565-46ab-b17e-cc1962c58bd6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:15.255029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf825a-c565-46ab-b17e-cc1962c58bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:15.256420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf825a-c565-46ab-b17e-cc1962c58bd6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:15.269791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 52/101] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:15.275939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a16d-5419-4ff9-9076-3b413afdca79 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:15.314163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:15.357676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69e02-48ad-4594-9971-b11edf43ebed None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.358062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69e02-48ad-4594-9971-b11edf43ebed None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.358276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db69e02-48ad-4594-9971-b11edf43ebed None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.359703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 53/102] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:15.365370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8dc3-5c87-4302-a0b6-494affc11f37 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.365647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8dc3-5c87-4302-a0b6-494affc11f37 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.366006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd8dc3-5c87-4302-a0b6-494affc11f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.421068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-53cd8dc3-5c87-4302-a0b6-494affc11f37 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:15.422312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-53cd8dc3-5c87-4302-a0b6-494affc11f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:15.459677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a16d-5419-4ff9-9076-3b413afdca79 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:15.510119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad20351-10bd-4a6e-b9da-159af14e3cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:15.510762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20351-10bd-4a6e-b9da-159af14e3cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.511097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20351-10bd-4a6e-b9da-159af14e3cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.511410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad20351-10bd-4a6e-b9da-159af14e3cb0 None admin] PATH_INFO: `/v3/users/b59b92dcc56844098add1148db5f6853` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.525991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad20351-10bd-4a6e-b9da-159af14e3cb0 None admin] RBAC: Authorizing `identity:get_user(user_id=b59b92dcc56844098add1148db5f6853)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:15.527733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad20351-10bd-4a6e-b9da-159af14e3cb0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:15.528584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:15.529619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 50/103] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:15 2022] GET /identity/v3/users/b59b92dcc56844098add1148db5f6853 => generated 289 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:15.530584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfeaa2-f6f7-4c5f-9a60-e300cd76506a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.530891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfeaa2-f6f7-4c5f-9a60-e300cd76506a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.531138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecfeaa2-f6f7-4c5f-9a60-e300cd76506a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.532449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 51/104] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:15.533343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee17e2-68ca-4bcc-bcd1-b8e3517da3e0 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.533622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee17e2-68ca-4bcc-bcd1-b8e3517da3e0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.533923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee17e2-68ca-4bcc-bcd1-b8e3517da3e0 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.535198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 52/105] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:15.538259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338070-46a4-4256-a009-e58113e0ec01 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.538924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338070-46a4-4256-a009-e58113e0ec01 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.539382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43338070-46a4-4256-a009-e58113e0ec01 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.540817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 53/106] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:15.545233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338070-46a4-4256-a009-e58113e0ec01 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:15.545356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 54/107] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:15.545356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96059b-b917-4698-aa62-70545996acef None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.545356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96059b-b917-4698-aa62-70545996acef None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.545356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96059b-b917-4698-aa62-70545996acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.570392 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8f96059b-b917-4698-aa62-70545996acef None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:15.572371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8f96059b-b917-4698-aa62-70545996acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:15.631170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:15.661122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43338070-46a4-4256-a009-e58113e0ec01 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:15.667356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 55/108] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:15.669071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98aee4-4e80-47a3-b917-cd18d9b321bb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.670322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98aee4-4e80-47a3-b917-cd18d9b321bb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.670813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa98aee4-4e80-47a3-b917-cd18d9b321bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.694954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-aa98aee4-4e80-47a3-b917-cd18d9b321bb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:15.696786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aa98aee4-4e80-47a3-b917-cd18d9b321bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:15.698600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45f4e-0917-4f70-a2ce-476b57706658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:15.699216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45f4e-0917-4f70-a2ce-476b57706658 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.699574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45f4e-0917-4f70-a2ce-476b57706658 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.699764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb45f4e-0917-4f70-a2ce-476b57706658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.772690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 56/109] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:15.774047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf59d1-17c8-4622-a0f4-d328aff1e1ab None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:15.774305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf59d1-17c8-4622-a0f4-d328aff1e1ab None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:15.774577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf59d1-17c8-4622-a0f4-d328aff1e1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:15.782693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45f4e-0917-4f70-a2ce-476b57706658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:15.784168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb45f4e-0917-4f70-a2ce-476b57706658 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:15.796062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-82bf59d1-17c8-4622-a0f4-d328aff1e1ab None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:15.797274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-82bf59d1-17c8-4622-a0f4-d328aff1e1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:15.847716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:15.866509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 57/110] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:15.867622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf59d1-17c8-4622-a0f4-d328aff1e1ab None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:15.882170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:15.925684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 54/111] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:15.940324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45f4e-0917-4f70-a2ce-476b57706658 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.068446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf59d1-17c8-4622-a0f4-d328aff1e1ab None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.100708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb45f4e-0917-4f70-a2ce-476b57706658 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.110796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72246a-1c84-4e24-b6e0-b546672d0fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.111445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72246a-1c84-4e24-b6e0-b546672d0fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.111726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72246a-1c84-4e24-b6e0-b546672d0fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.112092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72246a-1c84-4e24-b6e0-b546672d0fb5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.122947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72246a-1c84-4e24-b6e0-b546672d0fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-3f72246a-1c84-4e24-b6e0-b546672d0fb5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:16.128140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:16.128997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:16.129796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 58/112] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:16.130446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72246a-1c84-4e24-b6e0-b546672d0fb5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.141392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733896-1772-4347-a85f-36ee9ba63331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.142677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733896-1772-4347-a85f-36ee9ba63331 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.143159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733896-1772-4347-a85f-36ee9ba63331 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.143914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5733896-1772-4347-a85f-36ee9ba63331 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.145517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5733896-1772-4347-a85f-36ee9ba63331 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:16.147181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5733896-1772-4347-a85f-36ee9ba63331 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:16.149087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 55/113] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:15 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:16.150286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733896-1772-4347-a85f-36ee9ba63331 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.187730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:16.204914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:16.264391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72246a-1c84-4e24-b6e0-b546672d0fb5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.268724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5733896-1772-4347-a85f-36ee9ba63331 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.300387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d770c2-de04-47d1-9141-512f99d17a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.301083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d770c2-de04-47d1-9141-512f99d17a17 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.301381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d770c2-de04-47d1-9141-512f99d17a17 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.301683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d770c2-de04-47d1-9141-512f99d17a17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.305030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa55bf-6781-430d-baa1-ccadaf46d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.305707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa55bf-6781-430d-baa1-ccadaf46d44a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.306034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa55bf-6781-430d-baa1-ccadaf46d44a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.306282 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa55bf-6781-430d-baa1-ccadaf46d44a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.307431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa55bf-6781-430d-baa1-ccadaf46d44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:16.308985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aa55bf-6781-430d-baa1-ccadaf46d44a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:16.310909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 56/114] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:16.311497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa55bf-6781-430d-baa1-ccadaf46d44a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.312109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d770c2-de04-47d1-9141-512f99d17a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-a0d770c2-de04-47d1-9141-512f99d17a17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:16.316956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:16.317876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:16.318685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 59/115] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:16.319343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d770c2-de04-47d1-9141-512f99d17a17 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.420227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa55bf-6781-430d-baa1-ccadaf46d44a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.426122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d770c2-de04-47d1-9141-512f99d17a17 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.432015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:16.434064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:16.459190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.460004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.460284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.460620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.461178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.461302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:16.461579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:16.461973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.462310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.462642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.462985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:16.463486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] RBAC: Adding query filter params (role.id=0d6ecd5695f44214b3d13ce911b051a1, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8, user.id=b59b92dcc56844098add1148db5f6853) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:16.463864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:16.465408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:16.478872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 60/116] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/role_assignments?user.id=b59b92dcc56844098add1148db5f6853&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=0d6ecd5695f44214b3d13ce911b051a1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:16.478872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.479142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 57/117] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:16.479142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.595754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db379698-0739-4531-9dd5-c0ef3f295a25 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.601965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1181462-79b1-41c5-8cbe-5acd39c2de5d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.632410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be15e3-3c8a-4fe6-b390-aeb8d58273e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.633100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be15e3-3c8a-4fe6-b390-aeb8d58273e1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.633351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be15e3-3c8a-4fe6-b390-aeb8d58273e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.633625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be15e3-3c8a-4fe6-b390-aeb8d58273e1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.638144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006ac80-d09c-4025-99c2-07f25e7ec205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.639364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ac80-d09c-4025-99c2-07f25e7ec205 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.639720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ac80-d09c-4025-99c2-07f25e7ec205 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.640060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006ac80-d09c-4025-99c2-07f25e7ec205 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.640805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006ac80-d09c-4025-99c2-07f25e7ec205 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:16.642406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006ac80-d09c-4025-99c2-07f25e7ec205 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:16.646274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be15e3-3c8a-4fe6-b390-aeb8d58273e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c9be15e3-3c8a-4fe6-b390-aeb8d58273e1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:16.651858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:16.652937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:16.653945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:16.655120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 61/118] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:16.656045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be15e3-3c8a-4fe6-b390-aeb8d58273e1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.681944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 58/119] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:23:16 2022] POST /identity/v3/projects => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:16.685906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006ac80-d09c-4025-99c2-07f25e7ec205 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.706043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:16.729605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:16.795432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be15e3-3c8a-4fe6-b390-aeb8d58273e1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.834873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eb989-31a9-416e-91c6-8da7e0af9acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.835703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb989-31a9-416e-91c6-8da7e0af9acb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.836079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb989-31a9-416e-91c6-8da7e0af9acb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.836447 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb989-31a9-416e-91c6-8da7e0af9acb None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.837318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eb989-31a9-416e-91c6-8da7e0af9acb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:16.837954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eb989-31a9-416e-91c6-8da7e0af9acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:16.839471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eb989-31a9-416e-91c6-8da7e0af9acb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:16.845187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006ac80-d09c-4025-99c2-07f25e7ec205 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:16.850006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 62/120] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:16.851548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa332a2-60fe-4ee4-8a1c-a49f6db69681 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.851945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa332a2-60fe-4ee4-8a1c-a49f6db69681 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.852320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa332a2-60fe-4ee4-8a1c-a49f6db69681 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.853810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 63/121] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:16.854691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa332a2-60fe-4ee4-8a1c-a49f6db69681 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.896459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec40e-f890-4c5e-b516-9b94c6d38a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:16.897102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec40e-f890-4c5e-b516-9b94c6d38a13 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:16.898550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec40e-f890-4c5e-b516-9b94c6d38a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:16.898550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164ec40e-f890-4c5e-b516-9b94c6d38a13 None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:16.898918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec40e-f890-4c5e-b516-9b94c6d38a13 None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:16.900377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164ec40e-f890-4c5e-b516-9b94c6d38a13 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:16.902288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 59/122] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:16.903918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec40e-f890-4c5e-b516-9b94c6d38a13 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:16.975544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:16.998266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa332a2-60fe-4ee4-8a1c-a49f6db69681 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.019518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:17.029997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164ec40e-f890-4c5e-b516-9b94c6d38a13 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.044093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a04ec3-591d-40c3-9ec4-cef6cf293859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.044995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04ec3-591d-40c3-9ec4-cef6cf293859 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.045282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04ec3-591d-40c3-9ec4-cef6cf293859 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.045557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a04ec3-591d-40c3-9ec4-cef6cf293859 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.046796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04ec3-591d-40c3-9ec4-cef6cf293859 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:17.047107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04ec3-591d-40c3-9ec4-cef6cf293859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:17.048752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a04ec3-591d-40c3-9ec4-cef6cf293859 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:17.060300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 64/123] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:17.061877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e9a4b-65ff-41da-afb3-885220c69dc7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.062219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e9a4b-65ff-41da-afb3-885220c69dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.062493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e9a4b-65ff-41da-afb3-885220c69dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.069203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead53ad9-f2ff-47ea-9b29-0f3b3f7f8830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.070167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53ad9-f2ff-47ea-9b29-0f3b3f7f8830 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.070678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53ad9-f2ff-47ea-9b29-0f3b3f7f8830 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.071148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead53ad9-f2ff-47ea-9b29-0f3b3f7f8830 None admin] PATH_INFO: `/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.072518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead53ad9-f2ff-47ea-9b29-0f3b3f7f8830 None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd6fa62b8a4cbfaf378f47c21f9783)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:17.074335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead53ad9-f2ff-47ea-9b29-0f3b3f7f8830 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:17.076209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 60/124] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:16 2022] GET /identity/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:17.077273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead53ad9-f2ff-47ea-9b29-0f3b3f7f8830 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.082789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4c1e9a4b-65ff-41da-afb3-885220c69dc7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:17.083984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4c1e9a4b-65ff-41da-afb3-885220c69dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:17.168684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 65/125] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:17.169968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e9a4b-65ff-41da-afb3-885220c69dc7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.212248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead53ad9-f2ff-47ea-9b29-0f3b3f7f8830 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.286911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4855-5420-42ab-a62d-2c1d01586364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.287568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4855-5420-42ab-a62d-2c1d01586364 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.287854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4855-5420-42ab-a62d-2c1d01586364 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.288131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde4855-5420-42ab-a62d-2c1d01586364 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.289550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4855-5420-42ab-a62d-2c1d01586364 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:17.290569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:17.291796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cde4855-5420-42ab-a62d-2c1d01586364 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:17.293714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 61/126] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:17 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:17.294518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4855-5420-42ab-a62d-2c1d01586364 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.313999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e9a4b-65ff-41da-afb3-885220c69dc7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.352841 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:17.365421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbce17e-95a9-4b2d-9d61-1d4eabec7428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.366115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce17e-95a9-4b2d-9d61-1d4eabec7428 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.367471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce17e-95a9-4b2d-9d61-1d4eabec7428 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.367755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbce17e-95a9-4b2d-9d61-1d4eabec7428 None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.369540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbce17e-95a9-4b2d-9d61-1d4eabec7428 None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:17.371812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbce17e-95a9-4b2d-9d61-1d4eabec7428 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:17.373428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 66/127] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:17 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:17.374216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbce17e-95a9-4b2d-9d61-1d4eabec7428 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.489666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde4855-5420-42ab-a62d-2c1d01586364 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.527526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbce17e-95a9-4b2d-9d61-1d4eabec7428 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.532297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780b60-c12f-4d44-8bfd-6dd3eebbb9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.533196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780b60-c12f-4d44-8bfd-6dd3eebbb9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.533709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780b60-c12f-4d44-8bfd-6dd3eebbb9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.534206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41780b60-c12f-4d44-8bfd-6dd3eebbb9a9 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.536091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41780b60-c12f-4d44-8bfd-6dd3eebbb9a9 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:17.538715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41780b60-c12f-4d44-8bfd-6dd3eebbb9a9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:17.540923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 62/128] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:17 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:17.542021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780b60-c12f-4d44-8bfd-6dd3eebbb9a9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.573172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e346b51-320e-4fdb-b33e-15feeaf637e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.574140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e346b51-320e-4fdb-b33e-15feeaf637e1 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.574428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e346b51-320e-4fdb-b33e-15feeaf637e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.574704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e346b51-320e-4fdb-b33e-15feeaf637e1 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/users/f8365201de5f41589d4628aa197e5aae/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.577353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e346b51-320e-4fdb-b33e-15feeaf637e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd99e67c7d5401abc8f0c2d95e888a8, user_id=f8365201de5f41589d4628aa197e5aae, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:17.579467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e346b51-320e-4fdb-b33e-15feeaf637e1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:17.601255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 67/129] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:17 2022] PUT /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/users/f8365201de5f41589d4628aa197e5aae/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:17.602518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e346b51-320e-4fdb-b33e-15feeaf637e1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.619917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:17.669302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:17.677272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41780b60-c12f-4d44-8bfd-6dd3eebbb9a9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.714861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e346b51-320e-4fdb-b33e-15feeaf637e1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.718964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051a70a-fd49-4afc-8140-a656ed2c4ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.719620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051a70a-fd49-4afc-8140-a656ed2c4ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.719904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051a70a-fd49-4afc-8140-a656ed2c4ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.720178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051a70a-fd49-4afc-8140-a656ed2c4ce8 None admin] PATH_INFO: `/v3/projects/0a7642486a6f48fca5297d721aa8e08e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.721385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051a70a-fd49-4afc-8140-a656ed2c4ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=0a7642486a6f48fca5297d721aa8e08e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:17.722919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051a70a-fd49-4afc-8140-a656ed2c4ce8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:17.724668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 63/130] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:17 2022] GET /identity/v3/projects/0a7642486a6f48fca5297d721aa8e08e => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:17.725485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051a70a-fd49-4afc-8140-a656ed2c4ce8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.754862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccb14d-d0a6-4712-9afd-ed937c53398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.755945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccb14d-d0a6-4712-9afd-ed937c53398a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.756428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccb14d-d0a6-4712-9afd-ed937c53398a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.756947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfccb14d-d0a6-4712-9afd-ed937c53398a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.769321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfccb14d-d0a6-4712-9afd-ed937c53398a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-cfccb14d-d0a6-4712-9afd-ed937c53398a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:17.776712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:17.777647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:17.778507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:17.781233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 68/131] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:17.782334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccb14d-d0a6-4712-9afd-ed937c53398a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.839360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051a70a-fd49-4afc-8140-a656ed2c4ce8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:17.878068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5585114-60f8-4789-9ce7-035ca5fd087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:17.878901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585114-60f8-4789-9ce7-035ca5fd087d None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:17.879186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585114-60f8-4789-9ce7-035ca5fd087d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:17.879462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5585114-60f8-4789-9ce7-035ca5fd087d None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/users/b2fd6fa62b8a4cbfaf378f47c21f9783/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:17.883354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5585114-60f8-4789-9ce7-035ca5fd087d None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd99e67c7d5401abc8f0c2d95e888a8, user_id=b2fd6fa62b8a4cbfaf378f47c21f9783, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:17.883354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5585114-60f8-4789-9ce7-035ca5fd087d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:17.886166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:17.903572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 64/132] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:17 2022] PUT /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/users/b2fd6fa62b8a4cbfaf378f47c21f9783/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:17.904990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5585114-60f8-4789-9ce7-035ca5fd087d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:17.952770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:17.977725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfccb14d-d0a6-4712-9afd-ed937c53398a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:18.048619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c021-d208-4f15-874b-53133c712905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:18.049241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c021-d208-4f15-874b-53133c712905 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:18.049524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c021-d208-4f15-874b-53133c712905 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:18.049837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89c021-d208-4f15-874b-53133c712905 None admin] PATH_INFO: `/v3/projects/0a7642486a6f48fca5297d721aa8e08e/users/f8365201de5f41589d4628aa197e5aae/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:18.052918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89c021-d208-4f15-874b-53133c712905 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a7642486a6f48fca5297d721aa8e08e, user_id=f8365201de5f41589d4628aa197e5aae, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:18.054653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd89c021-d208-4f15-874b-53133c712905 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:18.080204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 69/133] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:17 2022] PUT /identity/v3/projects/0a7642486a6f48fca5297d721aa8e08e/users/f8365201de5f41589d4628aa197e5aae/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:18.095677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5585114-60f8-4789-9ce7-035ca5fd087d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:18.142424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:18.143072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:18.143354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:18.143689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:18.144386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:18.144688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:18.146186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:18.156647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 65/134] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:18.162885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c021-d208-4f15-874b-53133c712905 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:18.300727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89c021-d208-4f15-874b-53133c712905 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:18.332516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:18.339195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850240-8b2d-4c54-b098-b348304d3efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:18.340094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850240-8b2d-4c54-b098-b348304d3efa None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:18.340583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850240-8b2d-4c54-b098-b348304d3efa None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:18.341264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8850240-8b2d-4c54-b098-b348304d3efa None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:18.342571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850240-8b2d-4c54-b098-b348304d3efa None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:18.344165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8850240-8b2d-4c54-b098-b348304d3efa None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:18.346328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 70/135] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:18 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:18.354002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:18.459091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:18.475313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4482824-ac34-4fab-9ec7-c6b59ff74d30 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:18.510792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9196a-761c-4df2-a009-7bb6fe05b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:18.511436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9196a-761c-4df2-a009-7bb6fe05b813 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:18.511718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9196a-761c-4df2-a009-7bb6fe05b813 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:18.511993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9196a-761c-4df2-a009-7bb6fe05b813 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:18.517612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9196a-761c-4df2-a009-7bb6fe05b813 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:18.519098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9196a-761c-4df2-a009-7bb6fe05b813 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:18.520778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 66/136] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:18 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:18.526939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850240-8b2d-4c54-b098-b348304d3efa None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:18.639348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8850240-8b2d-4c54-b098-b348304d3efa None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:18.677545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ecda5-3af8-461c-b67f-faf05a647496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:18.678250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ecda5-3af8-461c-b67f-faf05a647496 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:18.678529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ecda5-3af8-461c-b67f-faf05a647496 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:18.678801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ecda5-3af8-461c-b67f-faf05a647496 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/users/f8365201de5f41589d4628aa197e5aae/roles/caea830f617d461ca08b1b747e2500a1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:18.681117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ecda5-3af8-461c-b67f-faf05a647496 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd99e67c7d5401abc8f0c2d95e888a8, user_id=f8365201de5f41589d4628aa197e5aae, role_id=caea830f617d461ca08b1b747e2500a1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:18.682622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ecda5-3af8-461c-b67f-faf05a647496 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:18.708593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 71/137] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:18 2022] PUT /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/users/f8365201de5f41589d4628aa197e5aae/roles/caea830f617d461ca08b1b747e2500a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:18.845320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b969963-fcd9-437f-b8c5-440ceb7748d3 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:18.845643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b969963-fcd9-437f-b8c5-440ceb7748d3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:18.845916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b969963-fcd9-437f-b8c5-440ceb7748d3 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:18.847466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 67/138] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:18.852970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0bf0-4c52-4d34-ae47-c212f4542640 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:18.853257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0bf0-4c52-4d34-ae47-c212f4542640 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:18.853532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8b0bf0-4c52-4d34-ae47-c212f4542640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:18.872720 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9c8b0bf0-4c52-4d34-ae47-c212f4542640 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:18.873976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9c8b0bf0-4c52-4d34-ae47-c212f4542640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:18.961067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:18.979752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 72/139] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:19.516593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b969963-fcd9-437f-b8c5-440ceb7748d3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:19.650757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b969963-fcd9-437f-b8c5-440ceb7748d3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:19.693218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212963e0-2662-4fd1-8038-1fc8e42d5c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:19.693902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212963e0-2662-4fd1-8038-1fc8e42d5c79 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:19.694181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212963e0-2662-4fd1-8038-1fc8e42d5c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:19.694453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212963e0-2662-4fd1-8038-1fc8e42d5c79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:19.711289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212963e0-2662-4fd1-8038-1fc8e42d5c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-212963e0-2662-4fd1-8038-1fc8e42d5c79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:19.716566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:19.719046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:19.720962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 68/140] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:19.726302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0bf0-4c52-4d34-ae47-c212f4542640 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:19.836895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d869d-812d-40b4-b504-a9896aea7a70 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:19.837077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d869d-812d-40b4-b504-a9896aea7a70 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:19.837336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d869d-812d-40b4-b504-a9896aea7a70 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:19.838941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 69/141] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:23:19.844886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb52d7-6ffb-4f2f-a3b0-dc5ac167ccac None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:19.845161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb52d7-6ffb-4f2f-a3b0-dc5ac167ccac None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:19.845436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb52d7-6ffb-4f2f-a3b0-dc5ac167ccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:19.872530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-56bb52d7-6ffb-4f2f-a3b0-dc5ac167ccac None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:19.873732 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-56bb52d7-6ffb-4f2f-a3b0-dc5ac167ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:19.893514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:19.899860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8b0bf0-4c52-4d34-ae47-c212f4542640 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:19.992746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:19.993585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:19.994092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:19.994492 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:19.995296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:19.996579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:19.998401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:20.016952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 73/142] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:20.023468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:20.039095 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 70/143] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:20.099313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:20.166847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fb64a-9fcd-42c8-b14e-a653184e7424 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:20.211507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee757-25cb-450b-8772-6a51792a17d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:20.212461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee757-25cb-450b-8772-6a51792a17d6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:20.212902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee757-25cb-450b-8772-6a51792a17d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:20.213360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ee757-25cb-450b-8772-6a51792a17d6 None admin] PATH_INFO: `/v3/users/b59b92dcc56844098add1148db5f6853` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:20.214689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee757-25cb-450b-8772-6a51792a17d6 None admin] RBAC: Authorizing `identity:get_user(user_id=b59b92dcc56844098add1148db5f6853)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:20.216326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ee757-25cb-450b-8772-6a51792a17d6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:20.218184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 74/144] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:20 2022] GET /identity/v3/users/b59b92dcc56844098add1148db5f6853 => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:20.224068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb52d7-6ffb-4f2f-a3b0-dc5ac167ccac None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:20.370717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb52d7-6ffb-4f2f-a3b0-dc5ac167ccac None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:20.404401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a70c1-73b6-44ac-a8c8-714809ed74cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:20.405042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a70c1-73b6-44ac-a8c8-714809ed74cb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:20.405326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a70c1-73b6-44ac-a8c8-714809ed74cb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:20.405601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a70c1-73b6-44ac-a8c8-714809ed74cb None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:20.406811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a70c1-73b6-44ac-a8c8-714809ed74cb None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:20.408279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a70c1-73b6-44ac-a8c8-714809ed74cb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:20.410119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 71/145] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:20 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:20.415972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee757-25cb-450b-8772-6a51792a17d6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:20.521874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ee757-25cb-450b-8772-6a51792a17d6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:20.545727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:20.560750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c20d1-a5bf-457b-8fb8-db10d5faab9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:20.561430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c20d1-a5bf-457b-8fb8-db10d5faab9a None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:20.561709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c20d1-a5bf-457b-8fb8-db10d5faab9a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:20.562017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c20d1-a5bf-457b-8fb8-db10d5faab9a None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/users/b59b92dcc56844098add1148db5f6853/roles/0d6ecd5695f44214b3d13ce911b051a1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:20.567025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c20d1-a5bf-457b-8fb8-db10d5faab9a None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd99e67c7d5401abc8f0c2d95e888a8, user_id=b59b92dcc56844098add1148db5f6853, role_id=0d6ecd5695f44214b3d13ce911b051a1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:20.568586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c20d1-a5bf-457b-8fb8-db10d5faab9a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:20.570251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a70c1-73b6-44ac-a8c8-714809ed74cb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:20.586055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:20.597860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 75/146] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:20 2022] PUT /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/users/b59b92dcc56844098add1148db5f6853/roles/0d6ecd5695f44214b3d13ce911b051a1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:20.724175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a70c1-73b6-44ac-a8c8-714809ed74cb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:20.776464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab2d44-2f3e-4303-b90b-1f2cae509090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:20.777120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2d44-2f3e-4303-b90b-1f2cae509090 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:20.777403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2d44-2f3e-4303-b90b-1f2cae509090 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:20.777674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab2d44-2f3e-4303-b90b-1f2cae509090 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:20.782434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab2d44-2f3e-4303-b90b-1f2cae509090 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:20.783908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeab2d44-2f3e-4303-b90b-1f2cae509090 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:20.785519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 72/147] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:20.791214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c20d1-a5bf-457b-8fb8-db10d5faab9a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:20.934406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c20d1-a5bf-457b-8fb8-db10d5faab9a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:20.985957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273454b6-3146-43ab-a46c-f5fe1dd71d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:20.986167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273454b6-3146-43ab-a46c-f5fe1dd71d8d None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:20.988044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273454b6-3146-43ab-a46c-f5fe1dd71d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:20.988044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273454b6-3146-43ab-a46c-f5fe1dd71d8d None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:20.988044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273454b6-3146-43ab-a46c-f5fe1dd71d8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:20.988808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273454b6-3146-43ab-a46c-f5fe1dd71d8d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:21.026789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 76/148] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:23:20 2022] POST /identity/v3/users => generated 283 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:21.328696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aac53a-649c-4c9c-a0f0-a5c1aabd673e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:21.328881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aac53a-649c-4c9c-a0f0-a5c1aabd673e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:21.329163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aac53a-649c-4c9c-a0f0-a5c1aabd673e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:21.330574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 73/149] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:21.336646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9debe8-5d70-44e3-a20f-6b8f3c755f07 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:21.336926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9debe8-5d70-44e3-a20f-6b8f3c755f07 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:21.337201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9debe8-5d70-44e3-a20f-6b8f3c755f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:21.360993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-eb9debe8-5d70-44e3-a20f-6b8f3c755f07 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:21.362236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-eb9debe8-5d70-44e3-a20f-6b8f3c755f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:21.396889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:21.443890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 77/150] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:21.462438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dfc5c-8d79-40b2-b339-a73be691bc99 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:21.462744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dfc5c-8d79-40b2-b339-a73be691bc99 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:21.462984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0dfc5c-8d79-40b2-b339-a73be691bc99 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:21.464536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 74/151] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:21.470313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5172f-9a94-4609-8b74-22d5d96dfc7e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:21.470608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5172f-9a94-4609-8b74-22d5d96dfc7e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:21.470865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d5172f-9a94-4609-8b74-22d5d96dfc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:21.499539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-50d5172f-9a94-4609-8b74-22d5d96dfc7e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:21.500734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-50d5172f-9a94-4609-8b74-22d5d96dfc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:21.582708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38cce-da0c-460f-b868-0c1686259cfd None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:21.583757 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 78/152] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:21.584096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38cce-da0c-460f-b868-0c1686259cfd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:21.584567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e38cce-da0c-460f-b868-0c1686259cfd None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:21.586291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 75/153] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:21.592007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf942d-8516-4de1-ad89-708ae78babd2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:21.592296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf942d-8516-4de1-ad89-708ae78babd2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:21.592569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf942d-8516-4de1-ad89-708ae78babd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:21.612900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d3cf942d-8516-4de1-ad89-708ae78babd2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:21.614160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d3cf942d-8516-4de1-ad89-708ae78babd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:21.701353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 79/154] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:21.828465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e09f38-1ac1-496f-a5ac-c60798b88883 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:21.829109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e09f38-1ac1-496f-a5ac-c60798b88883 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:21.829578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e09f38-1ac1-496f-a5ac-c60798b88883 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:21.831372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 76/155] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:21.836933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1145ab-da15-4435-b71e-00fd6896b35e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:21.837815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1145ab-da15-4435-b71e-00fd6896b35e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:21.838300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1145ab-da15-4435-b71e-00fd6896b35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:21.859142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0a1145ab-da15-4435-b71e-00fd6896b35e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:21.860665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0a1145ab-da15-4435-b71e-00fd6896b35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:21.861358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e09f38-1ac1-496f-a5ac-c60798b88883 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:21.896019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:21.964861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 80/156] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:21.966625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1145ab-da15-4435-b71e-00fd6896b35e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:21.969366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:21.996473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e09f38-1ac1-496f-a5ac-c60798b88883 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.037786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce1f8f-226c-44ce-817e-df08242ac597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.039558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce1f8f-226c-44ce-817e-df08242ac597 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.039845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce1f8f-226c-44ce-817e-df08242ac597 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.040116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce1f8f-226c-44ce-817e-df08242ac597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.051878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce1f8f-226c-44ce-817e-df08242ac597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e7ce1f8f-226c-44ce-817e-df08242ac597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:22.057294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:22.058195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:22.063951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 77/157] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:22.069761 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce1f8f-226c-44ce-817e-df08242ac597 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:22.095120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1145ab-da15-4435-b71e-00fd6896b35e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.134279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fc4a1-b7a5-4201-88f9-8369e53fb193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.135298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc4a1-b7a5-4201-88f9-8369e53fb193 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.135778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc4a1-b7a5-4201-88f9-8369e53fb193 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.136248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161fc4a1-b7a5-4201-88f9-8369e53fb193 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.148508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161fc4a1-b7a5-4201-88f9-8369e53fb193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-161fc4a1-b7a5-4201-88f9-8369e53fb193 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:22.155079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:22.156235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:22.157156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:22.159778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 81/158] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:22.166080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fc4a1-b7a5-4201-88f9-8369e53fb193 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:22.186363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:22.250390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce1f8f-226c-44ce-817e-df08242ac597 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.274187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161fc4a1-b7a5-4201-88f9-8369e53fb193 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.301169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.301816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.302101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.302612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.303061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:22.303362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:22.304837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:22.315583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.317537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.318200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.320209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.321119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:22.321639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:22.323810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:22.324291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 78/159] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:22.325329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:22.334687 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:22.342947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 82/160] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:22.343639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:22.437184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:22.463295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe27d1-f145-4c70-8f46-0963b029800b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.479034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b8b23-34a3-410c-8ce4-3b688c8a8f0c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.509381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2bf27-c956-44c7-84e0-a3ae92cb2177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.510210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2bf27-c956-44c7-84e0-a3ae92cb2177 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.510485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2bf27-c956-44c7-84e0-a3ae92cb2177 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.511052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2bf27-c956-44c7-84e0-a3ae92cb2177 None admin] PATH_INFO: `/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.512476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2bf27-c956-44c7-84e0-a3ae92cb2177 None admin] RBAC: Authorizing `identity:get_user(user_id=b2fd6fa62b8a4cbfaf378f47c21f9783)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:22.514457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2bf27-c956-44c7-84e0-a3ae92cb2177 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:22.516263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 83/161] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/users/b2fd6fa62b8a4cbfaf378f47c21f9783 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:22.517048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2bf27-c956-44c7-84e0-a3ae92cb2177 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:22.521886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edf4b8-c033-4be9-a66c-6e0d40483d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.522529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf4b8-c033-4be9-a66c-6e0d40483d69 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.522806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf4b8-c033-4be9-a66c-6e0d40483d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.523118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edf4b8-c033-4be9-a66c-6e0d40483d69 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.560414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edf4b8-c033-4be9-a66c-6e0d40483d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-20edf4b8-c033-4be9-a66c-6e0d40483d69 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:22.565795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:22.566748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:22.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 79/162] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:22.568202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edf4b8-c033-4be9-a66c-6e0d40483d69 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:22.639049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2bf27-c956-44c7-84e0-a3ae92cb2177 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.660790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:22.691537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38e699-892f-4a99-9200-3a6996281f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.692065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e699-892f-4a99-9200-3a6996281f09 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.692346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e699-892f-4a99-9200-3a6996281f09 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.692620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a38e699-892f-4a99-9200-3a6996281f09 None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.693793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38e699-892f-4a99-9200-3a6996281f09 None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:22.697682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a38e699-892f-4a99-9200-3a6996281f09 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:22.699576 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 84/163] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:22.700428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38e699-892f-4a99-9200-3a6996281f09 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:22.709780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edf4b8-c033-4be9-a66c-6e0d40483d69 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.726274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:22.754857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ecbc5-98dd-4faa-aa5f-97deef3c599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.756840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ecbc5-98dd-4faa-aa5f-97deef3c599c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.757588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ecbc5-98dd-4faa-aa5f-97deef3c599c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.758645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ecbc5-98dd-4faa-aa5f-97deef3c599c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.781821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ecbc5-98dd-4faa-aa5f-97deef3c599c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f40ecbc5-98dd-4faa-aa5f-97deef3c599c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:22.787545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:22.788646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:22.789528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:22.791909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 80/164] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:22.792916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ecbc5-98dd-4faa-aa5f-97deef3c599c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:22.888063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a38e699-892f-4a99-9200-3a6996281f09 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.907650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ecbc5-98dd-4faa-aa5f-97deef3c599c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:22.931741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:22.947667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.948592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3c683-906c-4f03-b054-88eeaaaab4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:22.949429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.950260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3c683-906c-4f03-b054-88eeaaaab4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:22.950739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.951220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3c683-906c-4f03-b054-88eeaaaab4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:22.951676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.952120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f3c683-906c-4f03-b054-88eeaaaab4c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:22.952987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:22.954011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:22.955904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:22.985876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 81/165] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:22.985876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:23.074847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3c683-906c-4f03-b054-88eeaaaab4c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:23.076351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f3c683-906c-4f03-b054-88eeaaaab4c9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:23.110168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:23.217453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8117116-1c6a-438c-8e38-24b6d333beac None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:23.254628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519cd61-a67d-4ce3-8f91-342d07d2c7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:23.255529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cd61-a67d-4ce3-8f91-342d07d2c7bc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:23.255959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cd61-a67d-4ce3-8f91-342d07d2c7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:23.256424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519cd61-a67d-4ce3-8f91-342d07d2c7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:23.265786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 85/166] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:23.265786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3c683-906c-4f03-b054-88eeaaaab4c9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:23.319158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:23.338057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519cd61-a67d-4ce3-8f91-342d07d2c7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:23.339997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519cd61-a67d-4ce3-8f91-342d07d2c7bc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:23.468152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 82/167] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:23.469493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519cd61-a67d-4ce3-8f91-342d07d2c7bc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:23.523418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f3c683-906c-4f03-b054-88eeaaaab4c9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:23.567045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:23.572740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:23.576031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519cd61-a67d-4ce3-8f91-342d07d2c7bc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:23.614647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd71d-68e4-49a2-94b7-28013614066f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:23.615620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd71d-68e4-49a2-94b7-28013614066f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:23.616084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd71d-68e4-49a2-94b7-28013614066f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:23.616551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cbd71d-68e4-49a2-94b7-28013614066f None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:23.617942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd71d-68e4-49a2-94b7-28013614066f None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:23.619588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cbd71d-68e4-49a2-94b7-28013614066f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:23.621476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 83/168] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:23 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:23.622692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd71d-68e4-49a2-94b7-28013614066f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:23.644530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:23.645158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:23.645431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:23.645695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:23.646402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:23.646702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:23.648139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:23.668954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 86/169] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:23.670133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:23.727453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cbd71d-68e4-49a2-94b7-28013614066f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:23.772537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82d618-2264-440f-b739-b0c552e6de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:23.774443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82d618-2264-440f-b739-b0c552e6de20 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:23.775127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82d618-2264-440f-b739-b0c552e6de20 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:23.776216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82d618-2264-440f-b739-b0c552e6de20 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:23.778808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82d618-2264-440f-b739-b0c552e6de20 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:23.780663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82d618-2264-440f-b739-b0c552e6de20 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:23.783421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 84/170] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:23 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:23.785365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82d618-2264-440f-b739-b0c552e6de20 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:23.827194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:23.855933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace35f18-b6fc-49f1-bd30-3f7cff6c6208 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:23.900945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82d618-2264-440f-b739-b0c552e6de20 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:23.911895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e963bec-ff63-47b2-8643-607e1907f0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:23.912505 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e963bec-ff63-47b2-8643-607e1907f0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:23.912737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e963bec-ff63-47b2-8643-607e1907f0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:23.913004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e963bec-ff63-47b2-8643-607e1907f0e3 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:23.918515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e963bec-ff63-47b2-8643-607e1907f0e3 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:23.919999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e963bec-ff63-47b2-8643-607e1907f0e3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:23.921694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 87/171] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:23 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:23.922487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e963bec-ff63-47b2-8643-607e1907f0e3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:23.939807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f449d74-f0a0-48d2-af93-3b266fd836d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:23.940928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f449d74-f0a0-48d2-af93-3b266fd836d7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:23.941409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f449d74-f0a0-48d2-af93-3b266fd836d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:23.941959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f449d74-f0a0-48d2-af93-3b266fd836d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:23.974622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:24.021706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f449d74-f0a0-48d2-af93-3b266fd836d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:24.029422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f449d74-f0a0-48d2-af93-3b266fd836d7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:24.031874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e963bec-ff63-47b2-8643-607e1907f0e3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:24.065699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:24.076580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025e3e-6b41-4a50-a851-99fb8699708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:24.077228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025e3e-6b41-4a50-a851-99fb8699708d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:24.077503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025e3e-6b41-4a50-a851-99fb8699708d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:24.077813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a025e3e-6b41-4a50-a851-99fb8699708d None admin] PATH_INFO: `/v3/users/f8365201de5f41589d4628aa197e5aae` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:24.079465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a025e3e-6b41-4a50-a851-99fb8699708d None admin] RBAC: Authorizing `identity:get_user(user_id=f8365201de5f41589d4628aa197e5aae)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:24.080920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a025e3e-6b41-4a50-a851-99fb8699708d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:24.082739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 88/172] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:23 2022] GET /identity/v3/users/f8365201de5f41589d4628aa197e5aae => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:24.083304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025e3e-6b41-4a50-a851-99fb8699708d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:24.206188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 85/173] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:24.206854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f449d74-f0a0-48d2-af93-3b266fd836d7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:24.240083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a025e3e-6b41-4a50-a851-99fb8699708d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:24.254531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:24.290255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328b697-fb46-4592-83a5-858724f73dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:24.290870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328b697-fb46-4592-83a5-858724f73dec None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:24.291147 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328b697-fb46-4592-83a5-858724f73dec None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:24.291417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328b697-fb46-4592-83a5-858724f73dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:24.292182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328b697-fb46-4592-83a5-858724f73dec None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8, user.id=b2fd6fa62b8a4cbfaf378f47c21f9783) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:24.292485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328b697-fb46-4592-83a5-858724f73dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:24.293949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328b697-fb46-4592-83a5-858724f73dec None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:24.308706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 89/174] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:24 2022] GET /identity/v3/role_assignments?user.id=b2fd6fa62b8a4cbfaf378f47c21f9783&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:24.316833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097a35-8e6f-4666-a025-7cac42e9c499 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:24.317111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097a35-8e6f-4666-a025-7cac42e9c499 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:24.317386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e097a35-8e6f-4666-a025-7cac42e9c499 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:24.319142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 90/175] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:24.319915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097a35-8e6f-4666-a025-7cac42e9c499 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:24.479346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f449d74-f0a0-48d2-af93-3b266fd836d7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:24.515693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e097a35-8e6f-4666-a025-7cac42e9c499 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:24.530484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:24.571514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:24.572151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:24.572426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:24.572694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:24.573446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] RBAC: Adding query filter params (role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8, user.id=f8365201de5f41589d4628aa197e5aae) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:24.573770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:24.575245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:24.591905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 86/176] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:24 2022] GET /identity/v3/role_assignments?user.id=f8365201de5f41589d4628aa197e5aae&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=d907003acd2748ac99d722b1aea4288a => generated 608 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:24.592751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:24.595366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b43e3-1593-46a2-91d7-a57772834ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:24.596001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b43e3-1593-46a2-91d7-a57772834ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:24.596277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b43e3-1593-46a2-91d7-a57772834ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:24.596545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b43e3-1593-46a2-91d7-a57772834ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:24.675808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:24.714304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b43e3-1593-46a2-91d7-a57772834ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:24.715835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b43e3-1593-46a2-91d7-a57772834ba0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:24.831616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeab728-5f46-41bc-9b33-d275b9388ec3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:24.877150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48425b18-14f9-4fef-b9e4-1ed987a6c821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:24.877810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48425b18-14f9-4fef-b9e4-1ed987a6c821 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:24.878079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48425b18-14f9-4fef-b9e4-1ed987a6c821 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:24.878348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48425b18-14f9-4fef-b9e4-1ed987a6c821 None admin] PATH_INFO: `/v3/projects/0a7642486a6f48fca5297d721aa8e08e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:24.880064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48425b18-14f9-4fef-b9e4-1ed987a6c821 None admin] RBAC: Authorizing `identity:get_project(project_id=0a7642486a6f48fca5297d721aa8e08e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:24.883368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48425b18-14f9-4fef-b9e4-1ed987a6c821 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:24.885177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 87/177] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:24 2022] GET /identity/v3/projects/0a7642486a6f48fca5297d721aa8e08e => generated 312 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:24.886426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5810-7770-45cb-892e-8a6dc3579e8e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:24.886702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5810-7770-45cb-892e-8a6dc3579e8e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:24.886973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5810-7770-45cb-892e-8a6dc3579e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:24.911507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8d1e5810-7770-45cb-892e-8a6dc3579e8e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:24.912706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8d1e5810-7770-45cb-892e-8a6dc3579e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:24.917870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 91/178] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:24.918747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b43e3-1593-46a2-91d7-a57772834ba0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:24.991031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 88/179] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:24.991975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5810-7770-45cb-892e-8a6dc3579e8e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:25.024176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:25.091819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:25.106367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5810-7770-45cb-892e-8a6dc3579e8e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:25.133551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b43e3-1593-46a2-91d7-a57772834ba0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:25.142615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f8c15-79e3-4a81-b289-0a27abe5623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:25.143315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f8c15-79e3-4a81-b289-0a27abe5623b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.143596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f8c15-79e3-4a81-b289-0a27abe5623b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.143865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f8c15-79e3-4a81-b289-0a27abe5623b None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.145118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f8c15-79e3-4a81-b289-0a27abe5623b None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:25.146667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f8c15-79e3-4a81-b289-0a27abe5623b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:25.148866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 89/180] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:24 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:25.153498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc82604-d124-43f9-8bdc-1cbecd687d0f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.153801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc82604-d124-43f9-8bdc-1cbecd687d0f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.154066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc82604-d124-43f9-8bdc-1cbecd687d0f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.155763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 90/181] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:25.158642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc82604-d124-43f9-8bdc-1cbecd687d0f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:25.195573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a27f14-b9c6-4432-9029-cff24f5ac303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:25.197510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27f14-b9c6-4432-9029-cff24f5ac303 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.197836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27f14-b9c6-4432-9029-cff24f5ac303 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.198108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a27f14-b9c6-4432-9029-cff24f5ac303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.198879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27f14-b9c6-4432-9029-cff24f5ac303 None admin] RBAC: Adding query filter params (role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=0a7642486a6f48fca5297d721aa8e08e, user.id=f8365201de5f41589d4628aa197e5aae) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:25.199184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27f14-b9c6-4432-9029-cff24f5ac303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:25.200725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a27f14-b9c6-4432-9029-cff24f5ac303 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:25.219646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 92/182] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:24 2022] GET /identity/v3/role_assignments?user.id=f8365201de5f41589d4628aa197e5aae&scope.project.id=0a7642486a6f48fca5297d721aa8e08e&role.id=d907003acd2748ac99d722b1aea4288a => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:25.220963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eca01-2caf-4242-b395-3ae92f87bdfb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.221244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eca01-2caf-4242-b395-3ae92f87bdfb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.221514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5eca01-2caf-4242-b395-3ae92f87bdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.258140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:25.276286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bd5eca01-2caf-4242-b395-3ae92f87bdfb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:25.277610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bd5eca01-2caf-4242-b395-3ae92f87bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:25.337365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc82604-d124-43f9-8bdc-1cbecd687d0f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:25.374856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6634195-bca0-4a27-951d-7c23660987f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:25.375409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6634195-bca0-4a27-951d-7c23660987f2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.375681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6634195-bca0-4a27-951d-7c23660987f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.375947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6634195-bca0-4a27-951d-7c23660987f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.376692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6634195-bca0-4a27-951d-7c23660987f2 None admin] RBAC: Adding query filter params (role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8, user.id=f8365201de5f41589d4628aa197e5aae) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:25.376999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6634195-bca0-4a27-951d-7c23660987f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:25.378544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6634195-bca0-4a27-951d-7c23660987f2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:25.389935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 91/183] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:25 2022] GET /identity/v3/role_assignments?user.id=f8365201de5f41589d4628aa197e5aae&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=caea830f617d461ca08b1b747e2500a1 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:25.391398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ad51-97bd-4fb4-9b98-59e1ad42a899 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.391678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ad51-97bd-4fb4-9b98-59e1ad42a899 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.391949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ad51-97bd-4fb4-9b98-59e1ad42a899 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.393353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 92/184] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:25.394077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ad51-97bd-4fb4-9b98-59e1ad42a899 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:25.429996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 93/185] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:25.436509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e2e2-35a3-415c-babd-32ee9fb688e2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.437401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e2e2-35a3-415c-babd-32ee9fb688e2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.437932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8e2e2-35a3-415c-babd-32ee9fb688e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.474702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bce8e2e2-35a3-415c-babd-32ee9fb688e2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:25.476395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bce8e2e2-35a3-415c-babd-32ee9fb688e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:25.618139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:25.628281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 94/186] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:25.644547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ad51-97bd-4fb4-9b98-59e1ad42a899 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:25.666996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:25.692965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861622bd-3d96-48ad-8f4a-63be0f77f71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:25.693604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861622bd-3d96-48ad-8f4a-63be0f77f71a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.693916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861622bd-3d96-48ad-8f4a-63be0f77f71a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.694190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861622bd-3d96-48ad-8f4a-63be0f77f71a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.710384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861622bd-3d96-48ad-8f4a-63be0f77f71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-861622bd-3d96-48ad-8f4a-63be0f77f71a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:25.715301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:25.716180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:25.716980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 93/187] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:25.723902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8e2e2-35a3-415c-babd-32ee9fb688e2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:25.796443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861622bd-3d96-48ad-8f4a-63be0f77f71a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:25.873445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce8e2e2-35a3-415c-babd-32ee9fb688e2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:25.920829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc73a04-ea77-41c9-827c-7f65f5f10e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:25.921560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73a04-ea77-41c9-827c-7f65f5f10e25 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.921861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73a04-ea77-41c9-827c-7f65f5f10e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.922282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc73a04-ea77-41c9-827c-7f65f5f10e25 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.923090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73a04-ea77-41c9-827c-7f65f5f10e25 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:25.923533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73a04-ea77-41c9-827c-7f65f5f10e25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:25.925179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc73a04-ea77-41c9-827c-7f65f5f10e25 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:25.934071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 95/188] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:25.935525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe95783-0e9d-4289-95cb-c8ba02650ed5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.935948 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe95783-0e9d-4289-95cb-c8ba02650ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.936365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe95783-0e9d-4289-95cb-c8ba02650ed5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.936482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861622bd-3d96-48ad-8f4a-63be0f77f71a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:25.938279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 96/189] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:25.942761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe95783-0e9d-4289-95cb-c8ba02650ed5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:25.969889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12150aeb-8631-4b64-b0e3-b139f4d95f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:25.970516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12150aeb-8631-4b64-b0e3-b139f4d95f51 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.970796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12150aeb-8631-4b64-b0e3-b139f4d95f51 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.971055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12150aeb-8631-4b64-b0e3-b139f4d95f51 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:25.981410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12150aeb-8631-4b64-b0e3-b139f4d95f51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-12150aeb-8631-4b64-b0e3-b139f4d95f51 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:25.986256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:25.987319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 94/190] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:25.989390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8298-2e0f-4e41-b246-0125a2a045e1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:25.990188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8298-2e0f-4e41-b246-0125a2a045e1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:25.990188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d8298-2e0f-4e41-b246-0125a2a045e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.006574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-112d8298-2e0f-4e41-b246-0125a2a045e1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:26.007793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-112d8298-2e0f-4e41-b246-0125a2a045e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:26.009490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.034427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.049477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe95783-0e9d-4289-95cb-c8ba02650ed5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.073639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 95/191] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:26.075085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8298-2e0f-4e41-b246-0125a2a045e1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.082137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8234dfc-0964-4944-9b2e-54b6782b47c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.082764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234dfc-0964-4944-9b2e-54b6782b47c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.083037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234dfc-0964-4944-9b2e-54b6782b47c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.083308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8234dfc-0964-4944-9b2e-54b6782b47c4 None admin] PATH_INFO: `/v3/users/b59b92dcc56844098add1148db5f6853` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.084425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8234dfc-0964-4944-9b2e-54b6782b47c4 None admin] RBAC: Authorizing `identity:get_user(user_id=b59b92dcc56844098add1148db5f6853)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.085955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8234dfc-0964-4944-9b2e-54b6782b47c4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.087513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 97/192] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:25 2022] GET /identity/v3/users/b59b92dcc56844098add1148db5f6853 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:26.089256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8234dfc-0964-4944-9b2e-54b6782b47c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.188416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d8298-2e0f-4e41-b246-0125a2a045e1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.196126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8234dfc-0964-4944-9b2e-54b6782b47c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.222198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025ab57-59cf-40e9-912a-04690ce74930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.222846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025ab57-59cf-40e9-912a-04690ce74930 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.223126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025ab57-59cf-40e9-912a-04690ce74930 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.223409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025ab57-59cf-40e9-912a-04690ce74930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.225223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.232008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.232614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.232884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.233150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.233868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025ab57-59cf-40e9-912a-04690ce74930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:26.233990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:26.234184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.235549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8025ab57-59cf-40e9-912a-04690ce74930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:26.239100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:26.239965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:26.240765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 96/193] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:26.241433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025ab57-59cf-40e9-912a-04690ce74930 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.249797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 98/194] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:26.250095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.271307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.351378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025ab57-59cf-40e9-912a-04690ce74930 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.355691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187152db-1d7d-4863-8f5c-1a0fcdb05447 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.384356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10544-b0e7-493c-9437-83e2fa6db8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.384959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10544-b0e7-493c-9437-83e2fa6db8bc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.385233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10544-b0e7-493c-9437-83e2fa6db8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.385499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b10544-b0e7-493c-9437-83e2fa6db8bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.389145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.389775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.390059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.390327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.390984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:26.391281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.392758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.401239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 99/195] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:26.402099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.455832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b10544-b0e7-493c-9437-83e2fa6db8bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.456234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.457324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b10544-b0e7-493c-9437-83e2fa6db8bc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.480791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.505264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80442ac-f3e7-485f-b7a9-3b1a70da8a22 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.540453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d81a4a-4cda-4a8d-a325-b6db1165f001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.541099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d81a4a-4cda-4a8d-a325-b6db1165f001 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.541387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d81a4a-4cda-4a8d-a325-b6db1165f001 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.541654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d81a4a-4cda-4a8d-a325-b6db1165f001 None admin] PATH_INFO: `/v3/users/cec3c19f133a4928800009bdc67acae3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.555713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d81a4a-4cda-4a8d-a325-b6db1165f001 None admin] RBAC: Authorizing `identity:get_user(user_id=cec3c19f133a4928800009bdc67acae3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.557255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d81a4a-4cda-4a8d-a325-b6db1165f001 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.558991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 100/196] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/users/cec3c19f133a4928800009bdc67acae3 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:26.559824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d81a4a-4cda-4a8d-a325-b6db1165f001 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.567662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 97/197] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:26.568619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10544-b0e7-493c-9437-83e2fa6db8bc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.668403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d81a4a-4cda-4a8d-a325-b6db1165f001 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.673118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b10544-b0e7-493c-9437-83e2fa6db8bc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.681742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.701491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.708107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc71fd9-8c23-46c2-b215-f99cd22e5752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.708688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc71fd9-8c23-46c2-b215-f99cd22e5752 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.708965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc71fd9-8c23-46c2-b215-f99cd22e5752 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.709238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc71fd9-8c23-46c2-b215-f99cd22e5752 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.710373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc71fd9-8c23-46c2-b215-f99cd22e5752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.711903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc71fd9-8c23-46c2-b215-f99cd22e5752 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.713484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301313dc-b479-45a2-a786-e9b0d0f159af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.713797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 101/198] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:26.714303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301313dc-b479-45a2-a786-e9b0d0f159af None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.714596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc71fd9-8c23-46c2-b215-f99cd22e5752 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.714702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301313dc-b479-45a2-a786-e9b0d0f159af None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.714910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301313dc-b479-45a2-a786-e9b0d0f159af None admin] PATH_INFO: `/v3/users/cec3c19f133a4928800009bdc67acae3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.716031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301313dc-b479-45a2-a786-e9b0d0f159af None admin] RBAC: Authorizing `identity:get_user(user_id=cec3c19f133a4928800009bdc67acae3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.717646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301313dc-b479-45a2-a786-e9b0d0f159af None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.720346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 98/199] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/users/cec3c19f133a4928800009bdc67acae3 => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:26.721120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301313dc-b479-45a2-a786-e9b0d0f159af None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.817068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc71fd9-8c23-46c2-b215-f99cd22e5752 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.827981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301313dc-b479-45a2-a786-e9b0d0f159af None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:26.849222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243559-8703-4c9f-bde5-c406f5ee3f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.849875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243559-8703-4c9f-bde5-c406f5ee3f36 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.850145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243559-8703-4c9f-bde5-c406f5ee3f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.850412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c243559-8703-4c9f-bde5-c406f5ee3f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.860522 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6caeb-a9ce-4e01-ba51-7d3eafda48cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:26.861145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6caeb-a9ce-4e01-ba51-7d3eafda48cd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:26.861419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6caeb-a9ce-4e01-ba51-7d3eafda48cd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:26.861685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6caeb-a9ce-4e01-ba51-7d3eafda48cd None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:26.862826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6caeb-a9ce-4e01-ba51-7d3eafda48cd None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.864274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6caeb-a9ce-4e01-ba51-7d3eafda48cd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.866102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 99/200] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:26.866669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6caeb-a9ce-4e01-ba51-7d3eafda48cd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:26.901665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.922173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c243559-8703-4c9f-bde5-c406f5ee3f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:26.923656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c243559-8703-4c9f-bde5-c406f5ee3f36 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:26.925062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:26.964432 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6caeb-a9ce-4e01-ba51-7d3eafda48cd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:27.000324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039533f-2c3a-4a81-a1e5-27ac518de5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:27.000943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039533f-2c3a-4a81-a1e5-27ac518de5f1 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:27.001406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039533f-2c3a-4a81-a1e5-27ac518de5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:27.001686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039533f-2c3a-4a81-a1e5-27ac518de5f1 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:27.002753 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039533f-2c3a-4a81-a1e5-27ac518de5f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:27.004188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b039533f-2c3a-4a81-a1e5-27ac518de5f1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:27.022985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 102/201] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:27.023870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243559-8703-4c9f-bde5-c406f5ee3f36 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:27.030479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 100/202] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:23:26 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:27.031440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039533f-2c3a-4a81-a1e5-27ac518de5f1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:27.115115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:27.136439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c243559-8703-4c9f-bde5-c406f5ee3f36 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:27.165520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039533f-2c3a-4a81-a1e5-27ac518de5f1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:27.176534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b579-e52f-4583-b145-891dd138a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:27.177170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b579-e52f-4583-b145-891dd138a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:27.177453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b579-e52f-4583-b145-891dd138a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:27.178165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6b579-e52f-4583-b145-891dd138a0a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:27.185205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:27.209795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:27.210402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:27.210717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:27.211694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:27.212010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] RBAC: Adding query filter params (role.id=0d6ecd5695f44214b3d13ce911b051a1, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8, user.id=b59b92dcc56844098add1148db5f6853) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:27.212316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:27.213964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:27.219947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 101/203] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:27 2022] GET /identity/v3/role_assignments?user.id=b59b92dcc56844098add1148db5f6853&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=0d6ecd5695f44214b3d13ce911b051a1 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:27.220735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:27.254094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6b579-e52f-4583-b145-891dd138a0a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:27.256085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6b579-e52f-4583-b145-891dd138a0a4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:27.344810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd96f85-923d-49f1-83a8-ee4c41e2245b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:27.370409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:27.394199 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0c3b4-f11d-42cc-9ef9-2d2cbae43e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:27.394866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c3b4-f11d-42cc-9ef9-2d2cbae43e28 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:27.395145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c3b4-f11d-42cc-9ef9-2d2cbae43e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:27.395417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0c3b4-f11d-42cc-9ef9-2d2cbae43e28 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:27.395516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 103/204] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:27.396654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0c3b4-f11d-42cc-9ef9-2d2cbae43e28 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:27.398188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0c3b4-f11d-42cc-9ef9-2d2cbae43e28 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:27.400397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 102/205] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:27 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:27.401373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b579-e52f-4583-b145-891dd138a0a4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:27.406671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0c3b4-f11d-42cc-9ef9-2d2cbae43e28 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:27.470964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:27.534304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6b579-e52f-4583-b145-891dd138a0a4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:27.541438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0c3b4-f11d-42cc-9ef9-2d2cbae43e28 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:27.578833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4443a-09db-4110-ad14-91dec20f1426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:27.579565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4443a-09db-4110-ad14-91dec20f1426 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:27.579837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4443a-09db-4110-ad14-91dec20f1426 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:27.580099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4443a-09db-4110-ad14-91dec20f1426 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:27.581280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4443a-09db-4110-ad14-91dec20f1426 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:27.582778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4443a-09db-4110-ad14-91dec20f1426 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:27.584413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 104/206] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:27 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:27.586274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f63c1-6a44-4217-84c9-59c29bb65a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:27.587133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f63c1-6a44-4217-84c9-59c29bb65a1b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:27.587620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f63c1-6a44-4217-84c9-59c29bb65a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:27.588080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f63c1-6a44-4217-84c9-59c29bb65a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:27.589005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f63c1-6a44-4217-84c9-59c29bb65a1b None admin] RBAC: Adding query filter params (role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=eadce91e10de414c90dbb6670817c373, user.id=cec3c19f133a4928800009bdc67acae3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:27.589794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f63c1-6a44-4217-84c9-59c29bb65a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:27.590224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4443a-09db-4110-ad14-91dec20f1426 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:27.591777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f63c1-6a44-4217-84c9-59c29bb65a1b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:27.597784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 103/207] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:27 2022] GET /identity/v3/role_assignments?user.id=cec3c19f133a4928800009bdc67acae3&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=caea830f617d461ca08b1b747e2500a1 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:27.646901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:27.707756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4443a-09db-4110-ad14-91dec20f1426 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:27.746002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac496f5c-6687-4491-a35a-a1577bd4cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:27.746545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496f5c-6687-4491-a35a-a1577bd4cc0b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:27.746852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496f5c-6687-4491-a35a-a1577bd4cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:27.747122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac496f5c-6687-4491-a35a-a1577bd4cc0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:27.747861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac496f5c-6687-4491-a35a-a1577bd4cc0b None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=eadce91e10de414c90dbb6670817c373, user.id=cec3c19f133a4928800009bdc67acae3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:27.748163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac496f5c-6687-4491-a35a-a1577bd4cc0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:27.749645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac496f5c-6687-4491-a35a-a1577bd4cc0b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:27.756590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 105/208] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:27 2022] GET /identity/v3/role_assignments?user.id=cec3c19f133a4928800009bdc67acae3&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:29.500794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f8eef-76fc-4e8d-9f10-24f74bd6bd90 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:29.501870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f8eef-76fc-4e8d-9f10-24f74bd6bd90 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:29.502381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f8eef-76fc-4e8d-9f10-24f74bd6bd90 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:29.503943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 104/209] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:29.509730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39766645-b104-48dc-a779-8c7a0695104b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:29.510592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39766645-b104-48dc-a779-8c7a0695104b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:29.511057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39766645-b104-48dc-a779-8c7a0695104b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:29.530621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-39766645-b104-48dc-a779-8c7a0695104b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:29.532218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-39766645-b104-48dc-a779-8c7a0695104b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:29.569172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135801c-f87b-4dd6-90cf-4c506eda2d83 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:29.569535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135801c-f87b-4dd6-90cf-4c506eda2d83 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:29.569714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135801c-f87b-4dd6-90cf-4c506eda2d83 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:29.571442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 105/210] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:29.576509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639196-b10a-4880-98d5-62c358395cef None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:29.576791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639196-b10a-4880-98d5-62c358395cef None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:29.577065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df639196-b10a-4880-98d5-62c358395cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:29.595124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-df639196-b10a-4880-98d5-62c358395cef None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:29.596322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-df639196-b10a-4880-98d5-62c358395cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:29.608524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 106/211] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:29.676679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:29.742604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffff2-166b-4f2b-b7fe-a9b64ac9c968 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:29.742924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffff2-166b-4f2b-b7fe-a9b64ac9c968 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:29.743152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaffff2-166b-4f2b-b7fe-a9b64ac9c968 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:29.744563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 107/213] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:29.749658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be24a3-0642-4b44-ab29-47de01d3c278 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:29.749976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be24a3-0642-4b44-ab29-47de01d3c278 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:29.750245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be24a3-0642-4b44-ab29-47de01d3c278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:29.768907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-02be24a3-0642-4b44-ab29-47de01d3c278 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:29.770069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-02be24a3-0642-4b44-ab29-47de01d3c278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:29.814097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:29.847067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 107/214] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:29.897442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2766d-9eaa-443a-9f81-e3ac3cb83ef8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:29.897834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2766d-9eaa-443a-9f81-e3ac3cb83ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:29.897998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2766d-9eaa-443a-9f81-e3ac3cb83ef8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:29.899480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 108/215] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:29.904683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69799-77d6-4d46-b7c0-bbc76c52bc9e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:29.904971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69799-77d6-4d46-b7c0-bbc76c52bc9e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:29.905246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69799-77d6-4d46-b7c0-bbc76c52bc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:29.913264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2766d-9eaa-443a-9f81-e3ac3cb83ef8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:29.927169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9ae69799-77d6-4d46-b7c0-bbc76c52bc9e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:29.928774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9ae69799-77d6-4d46-b7c0-bbc76c52bc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:29.958556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.004977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 108/216] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:30.010662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae69799-77d6-4d46-b7c0-bbc76c52bc9e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.026101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2766d-9eaa-443a-9f81-e3ac3cb83ef8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.061270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231e9c7-f60b-4bf0-8a77-d8062a52601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.061951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e9c7-f60b-4bf0-8a77-d8062a52601d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.062230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e9c7-f60b-4bf0-8a77-d8062a52601d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.062503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231e9c7-f60b-4bf0-8a77-d8062a52601d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.073186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231e9c7-f60b-4bf0-8a77-d8062a52601d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d231e9c7-f60b-4bf0-8a77-d8062a52601d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:30.078070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:30.078964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:30.084735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 109/217] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:23:30.087168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231e9c7-f60b-4bf0-8a77-d8062a52601d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.136387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae69799-77d6-4d46-b7c0-bbc76c52bc9e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.138157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.171880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cddb29-d8ff-41cd-8909-bef012e26bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.172515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cddb29-d8ff-41cd-8909-bef012e26bfa None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.172789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cddb29-d8ff-41cd-8909-bef012e26bfa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.173059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cddb29-d8ff-41cd-8909-bef012e26bfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.174180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cddb29-d8ff-41cd-8909-bef012e26bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:30.175617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cddb29-d8ff-41cd-8909-bef012e26bfa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:30.177180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 109/218] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:30.177957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cddb29-d8ff-41cd-8909-bef012e26bfa None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.207650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231e9c7-f60b-4bf0-8a77-d8062a52601d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.209302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.245601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.246245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.246523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.246792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.247461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:30.247760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:30.249255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:30.257413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 110/219] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:30.258327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.287894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cddb29-d8ff-41cd-8909-bef012e26bfa None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.320198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88438229-5301-4fcd-acdf-3a74c1b4a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.320841 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438229-5301-4fcd-acdf-3a74c1b4a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.321115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438229-5301-4fcd-acdf-3a74c1b4a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.321545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88438229-5301-4fcd-acdf-3a74c1b4a0e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.332891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88438229-5301-4fcd-acdf-3a74c1b4a0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-88438229-5301-4fcd-acdf-3a74c1b4a0e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:30.337817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:30.338750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:30.339538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 110/220] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:30.340192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88438229-5301-4fcd-acdf-3a74c1b4a0e7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.359099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06453073-3015-49b0-b755-f95702fa2d77 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.370775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.395326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b41dd-fed1-4243-9910-7aad9b9368dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.395941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b41dd-fed1-4243-9910-7aad9b9368dd None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.396212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b41dd-fed1-4243-9910-7aad9b9368dd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.396478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b41dd-fed1-4243-9910-7aad9b9368dd None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.397134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b41dd-fed1-4243-9910-7aad9b9368dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:30.398655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b41dd-fed1-4243-9910-7aad9b9368dd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:30.419876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 111/221] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:23:30 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:30.420914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b41dd-fed1-4243-9910-7aad9b9368dd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.451562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88438229-5301-4fcd-acdf-3a74c1b4a0e7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.463678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.493109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7fd0-bc4c-47a0-a519-9414ec4e5b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.493786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7fd0-bc4c-47a0-a519-9414ec4e5b80 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.494066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7fd0-bc4c-47a0-a519-9414ec4e5b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.494447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f7fd0-bc4c-47a0-a519-9414ec4e5b80 None admin] PATH_INFO: `/v3/users/17dabd3211954bc8a880b0d08247e2d0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.510867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7fd0-bc4c-47a0-a519-9414ec4e5b80 None admin] RBAC: Authorizing `identity:get_user(user_id=17dabd3211954bc8a880b0d08247e2d0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:30.513343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f7fd0-bc4c-47a0-a519-9414ec4e5b80 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:30.520947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 111/222] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/users/17dabd3211954bc8a880b0d08247e2d0 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:30.520947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7fd0-bc4c-47a0-a519-9414ec4e5b80 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.555832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b41dd-fed1-4243-9910-7aad9b9368dd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.593289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efb474-776c-4f27-9217-88ec04b2b8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.594238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efb474-776c-4f27-9217-88ec04b2b8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.594676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efb474-776c-4f27-9217-88ec04b2b8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.594945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efb474-776c-4f27-9217-88ec04b2b8a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.605572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39efb474-776c-4f27-9217-88ec04b2b8a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-39efb474-776c-4f27-9217-88ec04b2b8a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:30.611129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:30.612024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:30.612806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 112/223] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:30.613461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efb474-776c-4f27-9217-88ec04b2b8a6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.631764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.648641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f7fd0-bc4c-47a0-a519-9414ec4e5b80 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.694794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.695473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.695781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.696027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.696721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:30.697022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:30.699064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:30.708937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 112/224] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:30.710171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.715071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.743283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efb474-776c-4f27-9217-88ec04b2b8a6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.780606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef216b8c-bd62-401e-90cb-33daeebe3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.781234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216b8c-bd62-401e-90cb-33daeebe3843 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.781514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216b8c-bd62-401e-90cb-33daeebe3843 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.781805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef216b8c-bd62-401e-90cb-33daeebe3843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.842148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b95964-73ee-4484-82b2-5a6a3cd60155 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:30.856537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef216b8c-bd62-401e-90cb-33daeebe3843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:30.858339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef216b8c-bd62-401e-90cb-33daeebe3843 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:30.884514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:30.885499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:30.886016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:30.886541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:30.887397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:30.887925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:30.889880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:30.898815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 113/225] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:30.904228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:30.920280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.960574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:30.986154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 113/226] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:30.987242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef216b8c-bd62-401e-90cb-33daeebe3843 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:31.023221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368e06-a87c-493d-b9ce-dcd2bf350b29 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:31.062242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2df3-127b-4437-a276-937621e6cbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:31.063236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2df3-127b-4437-a276-937621e6cbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:31.063723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2df3-127b-4437-a276-937621e6cbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:31.064190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a2df3-127b-4437-a276-937621e6cbc0 None admin] PATH_INFO: `/v3/users/cec3c19f133a4928800009bdc67acae3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:31.065507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a2df3-127b-4437-a276-937621e6cbc0 None admin] RBAC: Authorizing `identity:get_user(user_id=cec3c19f133a4928800009bdc67acae3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:31.067288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a2df3-127b-4437-a276-937621e6cbc0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:31.069375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 114/227] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/users/cec3c19f133a4928800009bdc67acae3 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:31.070603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2df3-127b-4437-a276-937621e6cbc0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:31.103443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef216b8c-bd62-401e-90cb-33daeebe3843 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:31.145328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09514139-b90a-40b1-8d3b-8137ce0ef8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:31.146496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514139-b90a-40b1-8d3b-8137ce0ef8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:31.146984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514139-b90a-40b1-8d3b-8137ce0ef8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:31.147442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09514139-b90a-40b1-8d3b-8137ce0ef8f3 None admin] PATH_INFO: `/v3/users/cec3c19f133a4928800009bdc67acae3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:31.148794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09514139-b90a-40b1-8d3b-8137ce0ef8f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cec3c19f133a4928800009bdc67acae3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:31.150468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09514139-b90a-40b1-8d3b-8137ce0ef8f3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:31.152241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 114/228] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:30 2022] GET /identity/v3/users/cec3c19f133a4928800009bdc67acae3 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:31.157628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09514139-b90a-40b1-8d3b-8137ce0ef8f3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:31.162816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:31.186960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a2df3-127b-4437-a276-937621e6cbc0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:31.209135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:31.231157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6ae0f-2b1c-462f-b4bc-1c541ee5dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:31.231796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6ae0f-2b1c-462f-b4bc-1c541ee5dddb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:31.232072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6ae0f-2b1c-462f-b4bc-1c541ee5dddb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:31.232343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f6ae0f-2b1c-462f-b4bc-1c541ee5dddb None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:31.233997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6ae0f-2b1c-462f-b4bc-1c541ee5dddb None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:31.235701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f6ae0f-2b1c-462f-b4bc-1c541ee5dddb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:31.240491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 115/229] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:31 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:31.241723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6ae0f-2b1c-462f-b4bc-1c541ee5dddb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:31.274140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09514139-b90a-40b1-8d3b-8137ce0ef8f3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:31.309157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f6ef3-8451-4cc5-a25f-73323af1af72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:31.310197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f6ef3-8451-4cc5-a25f-73323af1af72 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:31.310663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f6ef3-8451-4cc5-a25f-73323af1af72 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:31.311136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f6ef3-8451-4cc5-a25f-73323af1af72 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:31.312469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f6ef3-8451-4cc5-a25f-73323af1af72 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:31.314160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f6ef3-8451-4cc5-a25f-73323af1af72 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:31.316010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 115/230] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:31 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:31.317030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f6ef3-8451-4cc5-a25f-73323af1af72 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:31.368953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f6ae0f-2b1c-462f-b4bc-1c541ee5dddb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:31.406478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1e1e-1616-4889-ab96-f2042309756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:31.407550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1e1e-1616-4889-ab96-f2042309756b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:31.408015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1e1e-1616-4889-ab96-f2042309756b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:31.408468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06b1e1e-1616-4889-ab96-f2042309756b None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:31.409916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b1e1e-1616-4889-ab96-f2042309756b None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:31.411657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06b1e1e-1616-4889-ab96-f2042309756b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:31.413532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 116/231] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:31 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:31.414577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1e1e-1616-4889-ab96-f2042309756b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:31.437276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f6ef3-8451-4cc5-a25f-73323af1af72 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:31.441338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:31.459664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:31.480607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618f636-18c4-480f-940c-766164475cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:31.481617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618f636-18c4-480f-940c-766164475cee None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:31.482118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618f636-18c4-480f-940c-766164475cee None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:31.482577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618f636-18c4-480f-940c-766164475cee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:31.483540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618f636-18c4-480f-940c-766164475cee None admin] RBAC: Adding query filter params (role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=eadce91e10de414c90dbb6670817c373, user.id=17dabd3211954bc8a880b0d08247e2d0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:31.484068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618f636-18c4-480f-940c-766164475cee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:31.485811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618f636-18c4-480f-940c-766164475cee None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:31.492240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 116/232] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:31 2022] GET /identity/v3/role_assignments?user.id=17dabd3211954bc8a880b0d08247e2d0&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=d907003acd2748ac99d722b1aea4288a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:31.493330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618f636-18c4-480f-940c-766164475cee None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:31.598623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06b1e1e-1616-4889-ab96-f2042309756b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:31.663383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f173c43-aea5-4527-8b06-acd5ce6400c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:31.666133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173c43-aea5-4527-8b06-acd5ce6400c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:31.666629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173c43-aea5-4527-8b06-acd5ce6400c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:31.667165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f173c43-aea5-4527-8b06-acd5ce6400c1 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373/users/cec3c19f133a4928800009bdc67acae3/roles/caea830f617d461ca08b1b747e2500a1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:31.671870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f173c43-aea5-4527-8b06-acd5ce6400c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=eadce91e10de414c90dbb6670817c373, user_id=cec3c19f133a4928800009bdc67acae3, role_id=caea830f617d461ca08b1b747e2500a1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:31.674975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f173c43-aea5-4527-8b06-acd5ce6400c1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:31.683509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618f636-18c4-480f-940c-766164475cee None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:31.701007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 117/233] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:31 2022] PUT /identity/v3/projects/eadce91e10de414c90dbb6670817c373/users/cec3c19f133a4928800009bdc67acae3/roles/caea830f617d461ca08b1b747e2500a1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:31.734178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e7a48-9060-4ae4-a94d-92afde120e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:31.735340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7a48-9060-4ae4-a94d-92afde120e9d None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:31.735804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7a48-9060-4ae4-a94d-92afde120e9d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:31.736277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e7a48-9060-4ae4-a94d-92afde120e9d None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373/users/cec3c19f133a4928800009bdc67acae3/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:31.738629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e7a48-9060-4ae4-a94d-92afde120e9d None admin] RBAC: Authorizing `identity:create_grant(project_id=eadce91e10de414c90dbb6670817c373, user_id=cec3c19f133a4928800009bdc67acae3, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:31.740406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e7a48-9060-4ae4-a94d-92afde120e9d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:31.758138 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 117/234] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:31 2022] PUT /identity/v3/projects/eadce91e10de414c90dbb6670817c373/users/cec3c19f133a4928800009bdc67acae3/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:32.856061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883756f-3f71-4f8b-a4cb-cf3b1721ac22 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:32.856592 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883756f-3f71-4f8b-a4cb-cf3b1721ac22 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:32.856592 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883756f-3f71-4f8b-a4cb-cf3b1721ac22 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:32.858234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 118/235] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:32.863464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480f4a-ba59-4a6e-971d-1b40f2047e14 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:32.863855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480f4a-ba59-4a6e-971d-1b40f2047e14 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:32.864033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8480f4a-ba59-4a6e-971d-1b40f2047e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:32.871742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a076b56-6838-4591-a71b-bfcd45db8c26 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:32.872018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a076b56-6838-4591-a71b-bfcd45db8c26 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:32.872296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a076b56-6838-4591-a71b-bfcd45db8c26 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:32.873562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 119/236] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:23:32.891697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012885cd-1f6f-4aa3-b012-edf907eb657b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:32.891996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012885cd-1f6f-4aa3-b012-edf907eb657b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:32.892250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012885cd-1f6f-4aa3-b012-edf907eb657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:32.894749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f8480f4a-ba59-4a6e-971d-1b40f2047e14 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:32.895957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f8480f4a-ba59-4a6e-971d-1b40f2047e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:32.917840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-012885cd-1f6f-4aa3-b012-edf907eb657b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:32.919052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-012885cd-1f6f-4aa3-b012-edf907eb657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:32.958164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:33.026458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 118/237] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:33.043963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:33.336879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8480f4a-ba59-4a6e-971d-1b40f2047e14 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:33.447571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8480f4a-ba59-4a6e-971d-1b40f2047e14 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:33.490438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d580-cb4b-4dda-b083-ebb051e0204f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:33.491461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d580-cb4b-4dda-b083-ebb051e0204f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:33.491934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d580-cb4b-4dda-b083-ebb051e0204f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:33.492474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8d580-cb4b-4dda-b083-ebb051e0204f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:33.493970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8d580-cb4b-4dda-b083-ebb051e0204f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:33.495714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8d580-cb4b-4dda-b083-ebb051e0204f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:33.497826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 119/239] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:33.503010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012885cd-1f6f-4aa3-b012-edf907eb657b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:33.516371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:33.518591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d580-cb4b-4dda-b083-ebb051e0204f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:33.586080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:33.671121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012885cd-1f6f-4aa3-b012-edf907eb657b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:33.686533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8d580-cb4b-4dda-b083-ebb051e0204f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:33.727082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed95df-05ea-49d9-9385-50de586b6ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:33.727758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed95df-05ea-49d9-9385-50de586b6ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:33.728036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed95df-05ea-49d9-9385-50de586b6ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:33.728303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed95df-05ea-49d9-9385-50de586b6ec4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:33.735881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba1512-8f0e-4528-9d01-ddd7bd770751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:33.736599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba1512-8f0e-4528-9d01-ddd7bd770751 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:33.736882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba1512-8f0e-4528-9d01-ddd7bd770751 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:33.737141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba1512-8f0e-4528-9d01-ddd7bd770751 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:33.737838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba1512-8f0e-4528-9d01-ddd7bd770751 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:33.739217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed95df-05ea-49d9-9385-50de586b6ec4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:33.739322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba1512-8f0e-4528-9d01-ddd7bd770751 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c0ed95df-05ea-49d9-9385-50de586b6ec4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:33.744275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:33.745165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:33.746023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 120/240] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:23:33.751329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed95df-05ea-49d9-9385-50de586b6ec4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:33.783761 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 121/241] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:23:33 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:23:33.919942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:33.926483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed95df-05ea-49d9-9385-50de586b6ec4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:33.971551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:33.972175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:33.972452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:33.972730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:33.973397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:33.973702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:33.975134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:33.984832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 121/242] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:33.991116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba1512-8f0e-4528-9d01-ddd7bd770751 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:34.063815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:34.107898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba1512-8f0e-4528-9d01-ddd7bd770751 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:34.145913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c3448-5998-492c-a67a-707276b6726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:34.146557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c3448-5998-492c-a67a-707276b6726e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.146832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c3448-5998-492c-a67a-707276b6726e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.147101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c3448-5998-492c-a67a-707276b6726e None admin] PATH_INFO: `/v3/users/45aee29306ba41fd86284e9723b671c9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.164321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c3448-5998-492c-a67a-707276b6726e None admin] RBAC: Authorizing `identity:get_user(user_id=45aee29306ba41fd86284e9723b671c9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:34.165852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c3448-5998-492c-a67a-707276b6726e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:34.167838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 122/243] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:33 2022] GET /identity/v3/users/45aee29306ba41fd86284e9723b671c9 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:34.173218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:34.181410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30561a-3122-4f12-98fa-0d5bc7e29b24 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.181637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30561a-3122-4f12-98fa-0d5bc7e29b24 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.181920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30561a-3122-4f12-98fa-0d5bc7e29b24 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.184106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 123/244] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:34.190789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6cc88-bc38-4410-8854-3e74889d5841 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.191066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6cc88-bc38-4410-8854-3e74889d5841 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.191332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6cc88-bc38-4410-8854-3e74889d5841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.212007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-eac6cc88-bc38-4410-8854-3e74889d5841 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:34.213226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-eac6cc88-bc38-4410-8854-3e74889d5841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:34.312405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c429b2-e31f-4705-a853-4e72a7d3cbe5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:34.316007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 124/245] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:34.351468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8bfcb-0173-49a0-8196-5c1ca93e62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:34.352097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bfcb-0173-49a0-8196-5c1ca93e62f8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.352381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bfcb-0173-49a0-8196-5c1ca93e62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.352653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c8bfcb-0173-49a0-8196-5c1ca93e62f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.384569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:34.428812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8bfcb-0173-49a0-8196-5c1ca93e62f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:34.430466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c8bfcb-0173-49a0-8196-5c1ca93e62f8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:34.439169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597b41f-b03f-46f1-a128-7d6c24920ed7 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.439720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597b41f-b03f-46f1-a128-7d6c24920ed7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.440175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597b41f-b03f-46f1-a128-7d6c24920ed7 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.441929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 125/246] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:23:34.449848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e9fc-d2a3-43c1-aef7-9e57e1c1840f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.450128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e9fc-d2a3-43c1-aef7-9e57e1c1840f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.450397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e9fc-d2a3-43c1-aef7-9e57e1c1840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.479650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b885e9fc-d2a3-43c1-aef7-9e57e1c1840f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:34.481190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b885e9fc-d2a3-43c1-aef7-9e57e1c1840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:34.552305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:34.582922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 122/247] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 03:23:34.583818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 126/248] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:34.588448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8bfcb-0173-49a0-8196-5c1ca93e62f8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:34.613700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e310e0-9089-47ea-987a-abfd6299c1bc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.614043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e310e0-9089-47ea-987a-abfd6299c1bc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.614361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e310e0-9089-47ea-987a-abfd6299c1bc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.615976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 127/249] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:34.622054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a284cd-f7ca-4d77-8e3d-8dd3a51f412a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.622338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a284cd-f7ca-4d77-8e3d-8dd3a51f412a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.622612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a284cd-f7ca-4d77-8e3d-8dd3a51f412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.645466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-10a284cd-f7ca-4d77-8e3d-8dd3a51f412a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:34.647463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-10a284cd-f7ca-4d77-8e3d-8dd3a51f412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:34.652896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:34.701921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c8bfcb-0173-49a0-8196-5c1ca93e62f8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:34.751013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593969b-bccd-44c7-b7da-c8c3859f07f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:34.751656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593969b-bccd-44c7-b7da-c8c3859f07f4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:34.751927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593969b-bccd-44c7-b7da-c8c3859f07f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:34.752192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593969b-bccd-44c7-b7da-c8c3859f07f4 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:34.753415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593969b-bccd-44c7-b7da-c8c3859f07f4 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:34.754886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593969b-bccd-44c7-b7da-c8c3859f07f4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:34.756517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 123/250] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:34 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:34.757272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593969b-bccd-44c7-b7da-c8c3859f07f4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:34.763960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 128/251] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:34.779816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a284cd-f7ca-4d77-8e3d-8dd3a51f412a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:34.948002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593969b-bccd-44c7-b7da-c8c3859f07f4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:34.963274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a284cd-f7ca-4d77-8e3d-8dd3a51f412a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:34.981921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:35.002125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:35.011176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283f8e-7bf8-4eb8-8c15-02fbcccc4f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.011930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283f8e-7bf8-4eb8-8c15-02fbcccc4f73 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.012213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283f8e-7bf8-4eb8-8c15-02fbcccc4f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.012488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a283f8e-7bf8-4eb8-8c15-02fbcccc4f73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.028839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.029502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.029766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.030045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.030795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] RBAC: Adding query filter params (role.id=0d6ecd5695f44214b3d13ce911b051a1, scope.project.id=eadce91e10de414c90dbb6670817c373, user.id=45aee29306ba41fd86284e9723b671c9) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:35.031102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:35.032561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:35.040843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a283f8e-7bf8-4eb8-8c15-02fbcccc4f73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:35.042223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 129/252] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:34 2022] GET /identity/v3/role_assignments?user.id=45aee29306ba41fd86284e9723b671c9&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=0d6ecd5695f44214b3d13ce911b051a1 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:35.043293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1a283f8e-7bf8-4eb8-8c15-02fbcccc4f73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:35.046655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:35.047632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:35.048418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 124/253] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:35.056177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283f8e-7bf8-4eb8-8c15-02fbcccc4f73 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:35.185656 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1639272-657a-43d7-9879-a7da36d160be None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:35.217411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a283f8e-7bf8-4eb8-8c15-02fbcccc4f73 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:35.233268 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf7b5-7e7e-4928-ba91-14c1551fe450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.234034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf7b5-7e7e-4928-ba91-14c1551fe450 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.234380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf7b5-7e7e-4928-ba91-14c1551fe450 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.236274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9cf7b5-7e7e-4928-ba91-14c1551fe450 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.265191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9cf7b5-7e7e-4928-ba91-14c1551fe450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9d9cf7b5-7e7e-4928-ba91-14c1551fe450 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:35.270241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:35.271168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:35.271960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:35.276679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 130/254] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:35.277541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf7b5-7e7e-4928-ba91-14c1551fe450 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:35.284721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.285350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.285625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.285978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.286636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:35.286909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:35.288334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:35.306279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 125/255] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:35.307162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:35.349941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:35.396793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:35.449414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78442f18-ec7a-4821-b848-686c2a6d72fc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:35.486491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.487037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.487315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.487584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.488267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:35.488568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:35.489981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:35.499356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 126/256] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:35.500189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:35.523931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9cf7b5-7e7e-4928-ba91-14c1551fe450 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:35.608271 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256a8b8-60b9-41f7-bac9-129c55bda525 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:35.618498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfc0d-fe6d-4a25-b3a0-e6cd62c37ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.619497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfc0d-fe6d-4a25-b3a0-e6cd62c37ba9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.619961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfc0d-fe6d-4a25-b3a0-e6cd62c37ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.620447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfc0d-fe6d-4a25-b3a0-e6cd62c37ba9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.626987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:35.640032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bfc0d-fe6d-4a25-b3a0-e6cd62c37ba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e23bfc0d-fe6d-4a25-b3a0-e6cd62c37ba9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:35.646391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:35.647265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:35.648101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:35.652567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 131/257] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:35.653618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfc0d-fe6d-4a25-b3a0-e6cd62c37ba9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:35.655490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabbca7-b818-42ae-b628-8a2bdda86387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.656174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbca7-b818-42ae-b628-8a2bdda86387 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.656450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbca7-b818-42ae-b628-8a2bdda86387 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.656733 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabbca7-b818-42ae-b628-8a2bdda86387 None admin] PATH_INFO: `/v3/users/cec3c19f133a4928800009bdc67acae3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.658076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabbca7-b818-42ae-b628-8a2bdda86387 None admin] RBAC: Authorizing `identity:get_user(user_id=cec3c19f133a4928800009bdc67acae3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:35.659525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deabbca7-b818-42ae-b628-8a2bdda86387 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:35.666165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 127/258] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/users/cec3c19f133a4928800009bdc67acae3 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:35.667067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabbca7-b818-42ae-b628-8a2bdda86387 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:35.805285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:35.822763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfc0d-fe6d-4a25-b3a0-e6cd62c37ba9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:35.830303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabbca7-b818-42ae-b628-8a2bdda86387 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:35.865641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.866743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.867289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.867760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.868644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:35.869141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:35.870974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:35.881236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 128/259] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:35.882475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:35.930156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:35.946499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38208e3a-cdcd-49aa-a4dd-7a45bdc8d77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:35.948467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208e3a-cdcd-49aa-a4dd-7a45bdc8d77c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:35.949898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208e3a-cdcd-49aa-a4dd-7a45bdc8d77c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:35.950539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38208e3a-cdcd-49aa-a4dd-7a45bdc8d77c None admin] PATH_INFO: `/v3/users/17dabd3211954bc8a880b0d08247e2d0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:35.954444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38208e3a-cdcd-49aa-a4dd-7a45bdc8d77c None admin] RBAC: Authorizing `identity:get_user(user_id=17dabd3211954bc8a880b0d08247e2d0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:35.956957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38208e3a-cdcd-49aa-a4dd-7a45bdc8d77c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:35.961168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 132/260] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/users/17dabd3211954bc8a880b0d08247e2d0 => generated 297 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:35.962447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38208e3a-cdcd-49aa-a4dd-7a45bdc8d77c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:36.030500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54863199-87d0-44e4-b53a-08bb06342965 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:36.105026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fb63b-926a-4d07-b9db-58e287c1f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:36.105571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fb63b-926a-4d07-b9db-58e287c1f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:36.105871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fb63b-926a-4d07-b9db-58e287c1f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:36.106146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3fb63b-926a-4d07-b9db-58e287c1f1d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:36.183073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38208e3a-cdcd-49aa-a4dd-7a45bdc8d77c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:36.225968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17aeac-a74b-45ad-a540-bee93c538aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:36.226965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17aeac-a74b-45ad-a540-bee93c538aa2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:36.227439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17aeac-a74b-45ad-a540-bee93c538aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:36.227922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17aeac-a74b-45ad-a540-bee93c538aa2 None admin] PATH_INFO: `/v3/users/cec3c19f133a4928800009bdc67acae3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:36.231462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17aeac-a74b-45ad-a540-bee93c538aa2 None admin] RBAC: Authorizing `identity:get_user(user_id=cec3c19f133a4928800009bdc67acae3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:36.233128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17aeac-a74b-45ad-a540-bee93c538aa2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:36.241855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 133/261] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/users/cec3c19f133a4928800009bdc67acae3 => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:36.242883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17aeac-a74b-45ad-a540-bee93c538aa2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:36.254333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fb63b-926a-4d07-b9db-58e287c1f1d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:36.256512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3fb63b-926a-4d07-b9db-58e287c1f1d6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:36.294292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:36.323789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:36.386577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 129/262] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:36.387962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fb63b-926a-4d07-b9db-58e287c1f1d6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:36.460654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17aeac-a74b-45ad-a540-bee93c538aa2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:36.498804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3fb63b-926a-4d07-b9db-58e287c1f1d6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:36.524116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20830-fa24-47b3-87af-c0a841727646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:36.524750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20830-fa24-47b3-87af-c0a841727646 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:36.525024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20830-fa24-47b3-87af-c0a841727646 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:36.525287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b20830-fa24-47b3-87af-c0a841727646 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:36.534502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b20830-fa24-47b3-87af-c0a841727646 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:36.535954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b20830-fa24-47b3-87af-c0a841727646 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:36.537038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df36db-68fd-419e-a622-750503d7fece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:36.537648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 134/263] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:36 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:36.537964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df36db-68fd-419e-a622-750503d7fece None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:36.538245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df36db-68fd-419e-a622-750503d7fece None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:36.538450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20830-fa24-47b3-87af-c0a841727646 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:36.538549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df36db-68fd-419e-a622-750503d7fece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:36.551860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:36.613705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df36db-68fd-419e-a622-750503d7fece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:36.615536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df36db-68fd-419e-a622-750503d7fece None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:36.759797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:36.766399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b20830-fa24-47b3-87af-c0a841727646 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:36.788966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 130/264] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:36.793594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df36db-68fd-419e-a622-750503d7fece None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:36.811651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3ae7-726d-4e39-ac63-abc6d3265ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:36.812290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3ae7-726d-4e39-ac63-abc6d3265ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:36.812563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3ae7-726d-4e39-ac63-abc6d3265ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:36.812830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86f3ae7-726d-4e39-ac63-abc6d3265ba1 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:36.813981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f3ae7-726d-4e39-ac63-abc6d3265ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:36.815422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86f3ae7-726d-4e39-ac63-abc6d3265ba1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:36.822075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 135/265] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:36 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:36.822832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3ae7-726d-4e39-ac63-abc6d3265ba1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:36.884659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:36.983848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df36db-68fd-419e-a622-750503d7fece None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:37.045142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365c45d-448e-4f6f-adc1-5a181df860da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:37.045799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c45d-448e-4f6f-adc1-5a181df860da None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.045882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86f3ae7-726d-4e39-ac63-abc6d3265ba1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:37.046117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c45d-448e-4f6f-adc1-5a181df860da None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.046274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365c45d-448e-4f6f-adc1-5a181df860da None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373/users/17dabd3211954bc8a880b0d08247e2d0/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.048367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365c45d-448e-4f6f-adc1-5a181df860da None admin] RBAC: Authorizing `identity:create_grant(project_id=eadce91e10de414c90dbb6670817c373, user_id=17dabd3211954bc8a880b0d08247e2d0, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:37.049859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365c45d-448e-4f6f-adc1-5a181df860da None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:37.064978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 131/266] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:36 2022] PUT /identity/v3/projects/eadce91e10de414c90dbb6670817c373/users/17dabd3211954bc8a880b0d08247e2d0/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:37.065608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365c45d-448e-4f6f-adc1-5a181df860da None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:37.098823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79bad5-e4fe-4b28-a634-759247f6dd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:37.099927 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bad5-e4fe-4b28-a634-759247f6dd7e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.100420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bad5-e4fe-4b28-a634-759247f6dd7e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.100891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79bad5-e4fe-4b28-a634-759247f6dd7e None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.102690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79bad5-e4fe-4b28-a634-759247f6dd7e None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:37.104511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79bad5-e4fe-4b28-a634-759247f6dd7e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:37.106670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 136/267] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:36 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:37.108132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a649442-6713-4afb-a341-7166aa338feb None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.108621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a649442-6713-4afb-a341-7166aa338feb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.109094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a649442-6713-4afb-a341-7166aa338feb None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.110684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 137/268] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:37.112033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6d8e-120c-4e3a-b5c7-c8d142cd9682 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.112644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6d8e-120c-4e3a-b5c7-c8d142cd9682 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.113113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c6d8e-120c-4e3a-b5c7-c8d142cd9682 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.114654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 138/269] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:37.120373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6d8e-120c-4e3a-b5c7-c8d142cd9682 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:37.163246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:37.222005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365c45d-448e-4f6f-adc1-5a181df860da None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:37.224916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:37.252969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c6d8e-120c-4e3a-b5c7-c8d142cd9682 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:37.277819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd3549-a9d2-402b-a32e-60139a3cd292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:37.278730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd3549-a9d2-402b-a32e-60139a3cd292 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.279011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd3549-a9d2-402b-a32e-60139a3cd292 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.279286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd3549-a9d2-402b-a32e-60139a3cd292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.280035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd3549-a9d2-402b-a32e-60139a3cd292 None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=eadce91e10de414c90dbb6670817c373, user.id=cec3c19f133a4928800009bdc67acae3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:37.280345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd3549-a9d2-402b-a32e-60139a3cd292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:37.282743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd3549-a9d2-402b-a32e-60139a3cd292 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:37.290408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 132/270] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:37 2022] GET /identity/v3/role_assignments?user.id=cec3c19f133a4928800009bdc67acae3&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:37.291751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac269-268b-478b-ad76-f1437c0220f8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.292039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac269-268b-478b-ad76-f1437c0220f8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.292312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ac269-268b-478b-ad76-f1437c0220f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.302156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a36c58-88a5-4c58-a5f5-32e5d0dfc3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:37.303470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a36c58-88a5-4c58-a5f5-32e5d0dfc3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.303953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a36c58-88a5-4c58-a5f5-32e5d0dfc3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.304422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a36c58-88a5-4c58-a5f5-32e5d0dfc3c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.305660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a36c58-88a5-4c58-a5f5-32e5d0dfc3c6 None admin] RBAC: Adding query filter params (role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=eadce91e10de414c90dbb6670817c373, user.id=cec3c19f133a4928800009bdc67acae3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:37.307122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a36c58-88a5-4c58-a5f5-32e5d0dfc3c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:37.309293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a36c58-88a5-4c58-a5f5-32e5d0dfc3c6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:37.313539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a26ac269-268b-478b-ad76-f1437c0220f8 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:37.314828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a26ac269-268b-478b-ad76-f1437c0220f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:37.317590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 139/271] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:37 2022] GET /identity/v3/role_assignments?user.id=cec3c19f133a4928800009bdc67acae3&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=caea830f617d461ca08b1b747e2500a1 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:37.320396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d0727-b3af-4a34-b3b9-55ee333213bc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.320968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d0727-b3af-4a34-b3b9-55ee333213bc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.321427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d0727-b3af-4a34-b3b9-55ee333213bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.361743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f77d0727-b3af-4a34-b3b9-55ee333213bc None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:37.365107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f77d0727-b3af-4a34-b3b9-55ee333213bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:37.457545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 133/272] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:37.458749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a85d-4277-4191-8417-4a217f93f5b2 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.459090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a85d-4277-4191-8417-4a217f93f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.459368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6a85d-4277-4191-8417-4a217f93f5b2 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.463128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 134/273] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:37.468929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551c24-a60d-479d-a68c-1f4e7b21c781 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.469260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551c24-a60d-479d-a68c-1f4e7b21c781 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.469484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9551c24-a60d-479d-a68c-1f4e7b21c781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.506501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 140/274] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:37.509601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a9551c24-a60d-479d-a68c-1f4e7b21c781 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:37.511138 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a9551c24-a60d-479d-a68c-1f4e7b21c781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:37.597799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 135/275] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:37.793671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d0727-b3af-4a34-b3b9-55ee333213bc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:37.822181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:37.822526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551c24-a60d-479d-a68c-1f4e7b21c781 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:37.862384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:37.910685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d0727-b3af-4a34-b3b9-55ee333213bc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:37.947689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ead0-05a3-4c20-8f7a-76ef021195c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:37.948344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ead0-05a3-4c20-8f7a-76ef021195c8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.948611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ead0-05a3-4c20-8f7a-76ef021195c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.948885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633ead0-05a3-4c20-8f7a-76ef021195c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.953981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9551c24-a60d-479d-a68c-1f4e7b21c781 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:37.960932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633ead0-05a3-4c20-8f7a-76ef021195c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9633ead0-05a3-4c20-8f7a-76ef021195c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:37.966228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:37.967101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:37.967981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 141/276] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:37.968631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ead0-05a3-4c20-8f7a-76ef021195c8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:37.995299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946698f-ed82-481e-ba03-f12d4203cfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:37.996024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946698f-ed82-481e-ba03-f12d4203cfd3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:37.996398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946698f-ed82-481e-ba03-f12d4203cfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:37.996671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946698f-ed82-481e-ba03-f12d4203cfd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:37.997786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946698f-ed82-481e-ba03-f12d4203cfd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:37.999252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946698f-ed82-481e-ba03-f12d4203cfd3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.001124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 136/277] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:38.001986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946698f-ed82-481e-ba03-f12d4203cfd3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:38.074322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:38.087541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633ead0-05a3-4c20-8f7a-76ef021195c8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.105410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:38.113481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946698f-ed82-481e-ba03-f12d4203cfd3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.129873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c446-bf4f-40c1-a1c9-3906e0fba11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.130652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c446-bf4f-40c1-a1c9-3906e0fba11d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.131242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c446-bf4f-40c1-a1c9-3906e0fba11d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.131562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747c446-bf4f-40c1-a1c9-3906e0fba11d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.145076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747c446-bf4f-40c1-a1c9-3906e0fba11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:38.148801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.149438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.149679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.149975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.150645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:38.150949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3747c446-bf4f-40c1-a1c9-3906e0fba11d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:38.151663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:38.153270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:38.156032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:38.157197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.157318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 142/278] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:38.157318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c446-bf4f-40c1-a1c9-3906e0fba11d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:38.169807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 137/279] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:38.169807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:38.267439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747c446-bf4f-40c1-a1c9-3906e0fba11d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.275015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5f7af-cdd5-47cd-98fb-3faa8efc4581 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.303906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c8b41-64fc-498a-abf9-0e5bf9831ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.304674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c8b41-64fc-498a-abf9-0e5bf9831ee0 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.305241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c8b41-64fc-498a-abf9-0e5bf9831ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.305527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43c8b41-64fc-498a-abf9-0e5bf9831ee0 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.306488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c8b41-64fc-498a-abf9-0e5bf9831ee0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:38.307936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43c8b41-64fc-498a-abf9-0e5bf9831ee0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.309421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.310059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.310430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.310702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.311349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:38.311647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:38.313300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.323898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 138/280] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:38.324817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:38.332619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 143/281] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:23:38 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:38.333883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c8b41-64fc-498a-abf9-0e5bf9831ee0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:38.339491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:38.359354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:38.454599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bb26e-6c6c-462d-b833-a3b1a4bcd122 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.460737 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43c8b41-64fc-498a-abf9-0e5bf9831ee0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.491688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176baea9-aa48-40ce-98af-3689a4a1f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.492643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176baea9-aa48-40ce-98af-3689a4a1f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.493057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176baea9-aa48-40ce-98af-3689a4a1f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.493491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176baea9-aa48-40ce-98af-3689a4a1f7a1 None admin] PATH_INFO: `/v3/users/d98122a2058449729d013c5b5ffbf609` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.498939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15eb15-5d92-4107-ab64-f405d94a445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.499736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15eb15-5d92-4107-ab64-f405d94a445b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.500118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15eb15-5d92-4107-ab64-f405d94a445b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.500537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a15eb15-5d92-4107-ab64-f405d94a445b None admin] PATH_INFO: `/v3/users/45aee29306ba41fd86284e9723b671c9` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.501875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15eb15-5d92-4107-ab64-f405d94a445b None admin] RBAC: Authorizing `identity:get_user(user_id=45aee29306ba41fd86284e9723b671c9)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:38.504089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a15eb15-5d92-4107-ab64-f405d94a445b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.505664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 144/282] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:38 2022] GET /identity/v3/users/45aee29306ba41fd86284e9723b671c9 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:38.510514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176baea9-aa48-40ce-98af-3689a4a1f7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=d98122a2058449729d013c5b5ffbf609)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:38.511659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15eb15-5d92-4107-ab64-f405d94a445b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:38.512468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176baea9-aa48-40ce-98af-3689a4a1f7a1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.519904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 139/283] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:38 2022] GET /identity/v3/users/d98122a2058449729d013c5b5ffbf609 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:38.521183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176baea9-aa48-40ce-98af-3689a4a1f7a1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:38.596384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:38.619081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:38.636875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a15eb15-5d92-4107-ab64-f405d94a445b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.651491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176baea9-aa48-40ce-98af-3689a4a1f7a1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.676149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caaf73-9194-4f3b-8956-d1c77aee818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.676792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caaf73-9194-4f3b-8956-d1c77aee818d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.677069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caaf73-9194-4f3b-8956-d1c77aee818d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.677341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caaf73-9194-4f3b-8956-d1c77aee818d None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.678485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caaf73-9194-4f3b-8956-d1c77aee818d None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:38.680022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caaf73-9194-4f3b-8956-d1c77aee818d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.681891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 145/284] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:38 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:38.688932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caaf73-9194-4f3b-8956-d1c77aee818d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:38.695086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ec9e27-e016-435f-97ac-bca44fa1cc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.696072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9e27-e016-435f-97ac-bca44fa1cc61 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.696352 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9e27-e016-435f-97ac-bca44fa1cc61 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.696631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ec9e27-e016-435f-97ac-bca44fa1cc61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.697363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9e27-e016-435f-97ac-bca44fa1cc61 None admin] RBAC: Adding query filter params (role.id=d907003acd2748ac99d722b1aea4288a, user.id=d98122a2058449729d013c5b5ffbf609, scope.system=all) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:38.697667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9e27-e016-435f-97ac-bca44fa1cc61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:38.699210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ec9e27-e016-435f-97ac-bca44fa1cc61 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.706448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 140/285] 10.222.0.48 () {56 vars in 1308 bytes} [Sat Sep 17 03:23:38 2022] GET /identity/v3/role_assignments?user.id=d98122a2058449729d013c5b5ffbf609&scope.system=all&role.id=d907003acd2748ac99d722b1aea4288a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:38.815764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caaf73-9194-4f3b-8956-d1c77aee818d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:38.853606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d500166-5654-47b3-8a9f-363e99e33269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:38.854336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500166-5654-47b3-8a9f-363e99e33269 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:38.854611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500166-5654-47b3-8a9f-363e99e33269 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:38.854880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d500166-5654-47b3-8a9f-363e99e33269 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373/users/45aee29306ba41fd86284e9723b671c9/roles/0d6ecd5695f44214b3d13ce911b051a1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:38.856919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500166-5654-47b3-8a9f-363e99e33269 None admin] RBAC: Authorizing `identity:create_grant(project_id=eadce91e10de414c90dbb6670817c373, user_id=45aee29306ba41fd86284e9723b671c9, role_id=0d6ecd5695f44214b3d13ce911b051a1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:38.858458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d500166-5654-47b3-8a9f-363e99e33269 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:38.879902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:38.885408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 146/286] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:23:38 2022] PUT /identity/v3/projects/eadce91e10de414c90dbb6670817c373/users/45aee29306ba41fd86284e9723b671c9/roles/0d6ecd5695f44214b3d13ce911b051a1 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:39.633919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196746c-176b-488a-bcb6-5f7da41d0274 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:39.634481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196746c-176b-488a-bcb6-5f7da41d0274 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:39.634481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196746c-176b-488a-bcb6-5f7da41d0274 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:39.636059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 141/287] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:39.641676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b91979-c229-4a13-b2f9-984535ed0403 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:39.642138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b91979-c229-4a13-b2f9-984535ed0403 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:39.642256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b91979-c229-4a13-b2f9-984535ed0403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:39.670825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-84b91979-c229-4a13-b2f9-984535ed0403 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:39.672048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-84b91979-c229-4a13-b2f9-984535ed0403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:39.756323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 147/288] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:40.150875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196746c-176b-488a-bcb6-5f7da41d0274 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:40.283814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196746c-176b-488a-bcb6-5f7da41d0274 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:40.339838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854dc84-8c25-4bcb-b19b-2e2e2932d12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:40.340479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854dc84-8c25-4bcb-b19b-2e2e2932d12e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:40.340759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854dc84-8c25-4bcb-b19b-2e2e2932d12e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:40.341033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1854dc84-8c25-4bcb-b19b-2e2e2932d12e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:40.352065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:40.355852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1854dc84-8c25-4bcb-b19b-2e2e2932d12e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1854dc84-8c25-4bcb-b19b-2e2e2932d12e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:40.365711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:40.366599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:40.368142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 142/289] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:40.372752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b91979-c229-4a13-b2f9-984535ed0403 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:40.514320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b91979-c229-4a13-b2f9-984535ed0403 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:40.554317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:40.561692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:40.562341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:40.562659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:40.562929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:40.563598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:40.563893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:40.565265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:40.574090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 148/290] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:40.583010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854dc84-8c25-4bcb-b19b-2e2e2932d12e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:40.725892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1854dc84-8c25-4bcb-b19b-2e2e2932d12e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:40.774363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042503-dde4-4abf-bdff-09c55d5500d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:40.775420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042503-dde4-4abf-bdff-09c55d5500d3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:40.775908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042503-dde4-4abf-bdff-09c55d5500d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:40.776369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042503-dde4-4abf-bdff-09c55d5500d3 None admin] PATH_INFO: `/v3/users/17dabd3211954bc8a880b0d08247e2d0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:40.782412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042503-dde4-4abf-bdff-09c55d5500d3 None admin] RBAC: Authorizing `identity:get_user(user_id=17dabd3211954bc8a880b0d08247e2d0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:40.784078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5042503-dde4-4abf-bdff-09c55d5500d3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:40.785890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 143/291] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:40 2022] GET /identity/v3/users/17dabd3211954bc8a880b0d08247e2d0 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:40.791934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:40.936002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192678ad-e042-4196-b45a-3ab3b950bb16 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:40.984724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a14b5f-6c6e-41ec-875b-d4f8bf306a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:40.984724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a14b5f-6c6e-41ec-875b-d4f8bf306a33 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:40.984724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a14b5f-6c6e-41ec-875b-d4f8bf306a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:40.984724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a14b5f-6c6e-41ec-875b-d4f8bf306a33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.049957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:41.063402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a14b5f-6c6e-41ec-875b-d4f8bf306a33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:41.064883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a14b5f-6c6e-41ec-875b-d4f8bf306a33 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:41.113614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c8df7-93e3-4d62-99e6-dcd7ee1df21a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.114018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c8df7-93e3-4d62-99e6-dcd7ee1df21a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.114285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c8df7-93e3-4d62-99e6-dcd7ee1df21a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.117915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 144/292] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:41.125122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da61be-e4de-4b47-b98f-5d8c7e5e5772 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.125390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da61be-e4de-4b47-b98f-5d8c7e5e5772 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.125662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da61be-e4de-4b47-b98f-5d8c7e5e5772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.151520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d4da61be-e4de-4b47-b98f-5d8c7e5e5772 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:41.152709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d4da61be-e4de-4b47-b98f-5d8c7e5e5772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:41.229774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:41.243777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 145/293] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:41.247467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 149/294] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:41.253144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da61be-e4de-4b47-b98f-5d8c7e5e5772 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:41.326632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f815c8-6453-4b37-9ea0-6484d2ed12a5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.326955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f815c8-6453-4b37-9ea0-6484d2ed12a5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.327168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f815c8-6453-4b37-9ea0-6484d2ed12a5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.328852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 150/295] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:41.334248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ae13-23a5-418f-80b3-60a17ed82ad0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.334529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ae13-23a5-418f-80b3-60a17ed82ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.334798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2ae13-23a5-418f-80b3-60a17ed82ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.353794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-86b2ae13-23a5-418f-80b3-60a17ed82ad0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:41.354974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-86b2ae13-23a5-418f-80b3-60a17ed82ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:41.426065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 151/296] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:23:41.436253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da61be-e4de-4b47-b98f-5d8c7e5e5772 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:41.481887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174ce5b-28c7-4c0e-b11c-8a6b11d8e9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:41.482509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174ce5b-28c7-4c0e-b11c-8a6b11d8e9a6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.482780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174ce5b-28c7-4c0e-b11c-8a6b11d8e9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.483050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174ce5b-28c7-4c0e-b11c-8a6b11d8e9a6 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.486472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174ce5b-28c7-4c0e-b11c-8a6b11d8e9a6 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:41.487930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174ce5b-28c7-4c0e-b11c-8a6b11d8e9a6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:41.489925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 146/297] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:41 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:41.495930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2ae13-23a5-418f-80b3-60a17ed82ad0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:41.525300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:41.529997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174ce5b-28c7-4c0e-b11c-8a6b11d8e9a6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:41.612304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:41.623066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b2ae13-23a5-418f-80b3-60a17ed82ad0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:41.659453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08825fd-57f7-4863-9bcb-dd64d49dbcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:41.660140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174ce5b-28c7-4c0e-b11c-8a6b11d8e9a6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:41.660253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08825fd-57f7-4863-9bcb-dd64d49dbcea None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.660503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08825fd-57f7-4863-9bcb-dd64d49dbcea None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.660839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08825fd-57f7-4863-9bcb-dd64d49dbcea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.661629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08825fd-57f7-4863-9bcb-dd64d49dbcea None admin] RBAC: Adding query filter params (role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=eadce91e10de414c90dbb6670817c373, user.id=17dabd3211954bc8a880b0d08247e2d0) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:41.662022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08825fd-57f7-4863-9bcb-dd64d49dbcea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:41.663566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08825fd-57f7-4863-9bcb-dd64d49dbcea None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:41.671190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 152/298] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:41 2022] GET /identity/v3/role_assignments?user.id=17dabd3211954bc8a880b0d08247e2d0&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=d907003acd2748ac99d722b1aea4288a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:41.672636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378992a-7c8b-421f-a097-a8070e0812d4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.672979 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378992a-7c8b-421f-a097-a8070e0812d4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.673311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378992a-7c8b-421f-a097-a8070e0812d4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.674819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 153/299] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:41.683701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137008f4-8966-43a6-be63-ec20e418ac35 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.684018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137008f4-8966-43a6-be63-ec20e418ac35 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.684235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137008f4-8966-43a6-be63-ec20e418ac35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.718301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3dfb2-bf0c-44b3-ae6b-2339284be960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:41.718877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-137008f4-8966-43a6-be63-ec20e418ac35 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:41.719066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3dfb2-bf0c-44b3-ae6b-2339284be960 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.719223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3dfb2-bf0c-44b3-ae6b-2339284be960 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.719469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3dfb2-bf0c-44b3-ae6b-2339284be960 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.720138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-137008f4-8966-43a6-be63-ec20e418ac35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:41.734129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3dfb2-bf0c-44b3-ae6b-2339284be960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2fb3dfb2-bf0c-44b3-ae6b-2339284be960 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:41.742187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:41.744482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:41.746366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 147/300] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:41.748007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383a33f-a5da-4db4-ad2f-96dab2700a97 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.748007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383a33f-a5da-4db4-ad2f-96dab2700a97 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.748007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383a33f-a5da-4db4-ad2f-96dab2700a97 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.749229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 148/301] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:41.750403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383a33f-a5da-4db4-ad2f-96dab2700a97 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:41.813152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 154/302] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:41.814528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e3f5-e8dc-4ff4-9f42-b476da686e01 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.814806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e3f5-e8dc-4ff4-9f42-b476da686e01 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.815184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01e3f5-e8dc-4ff4-9f42-b476da686e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.837623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7e01e3f5-e8dc-4ff4-9f42-b476da686e01 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:41.838994 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7e01e3f5-e8dc-4ff4-9f42-b476da686e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:41.853705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:41.869162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383a33f-a5da-4db4-ad2f-96dab2700a97 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:41.899264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:41.911764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:41.912377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:41.912647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:41.912916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:41.913582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:41.914035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:41.915432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:41.923900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 149/303] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:41.924321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 155/304] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:41.926611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:41.929240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e3f5-e8dc-4ff4-9f42-b476da686e01 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.045634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01e3f5-e8dc-4ff4-9f42-b476da686e01 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.058453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0dc6e-c70e-4e50-a1b7-587ca40d20b8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.085693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45de1ec-620f-44da-8a73-dfb14327cf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.086459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45de1ec-620f-44da-8a73-dfb14327cf6b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.086744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45de1ec-620f-44da-8a73-dfb14327cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.087018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45de1ec-620f-44da-8a73-dfb14327cf6b None admin] PATH_INFO: `/v3/users/da0324ca252c43e89c54a2a3f56a143e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.098790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ab58e-fd30-4085-8a7d-3d41c047b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.099504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ab58e-fd30-4085-8a7d-3d41c047b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.099783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ab58e-fd30-4085-8a7d-3d41c047b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.100052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ab58e-fd30-4085-8a7d-3d41c047b0d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.100909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45de1ec-620f-44da-8a73-dfb14327cf6b None admin] RBAC: Authorizing `identity:get_user(user_id=da0324ca252c43e89c54a2a3f56a143e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.101146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ab58e-fd30-4085-8a7d-3d41c047b0d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.102610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45de1ec-620f-44da-8a73-dfb14327cf6b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.102707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ab58e-fd30-4085-8a7d-3d41c047b0d3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.104365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 150/305] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:42.104478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 156/306] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:41 2022] GET /identity/v3/users/da0324ca252c43e89c54a2a3f56a143e => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:42.105874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ab58e-fd30-4085-8a7d-3d41c047b0d3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.110009 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45de1ec-620f-44da-8a73-dfb14327cf6b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.114442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:42.164897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:42.211521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ab58e-fd30-4085-8a7d-3d41c047b0d3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.214751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45de1ec-620f-44da-8a73-dfb14327cf6b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.244086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0779e-9119-4186-b070-03ac07887c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.244718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0779e-9119-4186-b070-03ac07887c82 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.244992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0779e-9119-4186-b070-03ac07887c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.245260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0779e-9119-4186-b070-03ac07887c82 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.248898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.249524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.249830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.250099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.250819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] RBAC: Adding query filter params (role.id=0d6ecd5695f44214b3d13ce911b051a1, user.id=da0324ca252c43e89c54a2a3f56a143e, scope.system=all) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:42.251125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.252561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.255029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0779e-9119-4186-b070-03ac07887c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:42.257409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 157/307] 10.222.0.48 () {56 vars in 1308 bytes} [Sat Sep 17 03:23:42 2022] GET /identity/v3/role_assignments?user.id=da0324ca252c43e89c54a2a3f56a143e&scope.system=all&role.id=0d6ecd5695f44214b3d13ce911b051a1 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:42.266054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-87d0779e-9119-4186-b070-03ac07887c82 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:42.266145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:42.267022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 151/308] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:42.267830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0779e-9119-4186-b070-03ac07887c82 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.333265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:42.369631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d688f-1ddc-4ad5-8669-cd56f3d47075 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.384544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0779e-9119-4186-b070-03ac07887c82 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.402152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:42.407409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4563e0-f953-4436-a233-750c592b7cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.408032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4563e0-f953-4436-a233-750c592b7cc4 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.408303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4563e0-f953-4436-a233-750c592b7cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.408567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4563e0-f953-4436-a233-750c592b7cc4 None admin] PATH_INFO: `/v3/groups` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.409203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4563e0-f953-4436-a233-750c592b7cc4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.410710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4563e0-f953-4436-a233-750c592b7cc4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.423233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2c51-6178-440a-a4a0-f763cd410653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.423929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2c51-6178-440a-a4a0-f763cd410653 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.424174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2c51-6178-440a-a4a0-f763cd410653 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.424445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2c51-6178-440a-a4a0-f763cd410653 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.430643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 158/309] 10.222.0.48 () {60 vars in 1134 bytes} [Sat Sep 17 03:23:42 2022] POST /identity/v3/groups => generated 229 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:42.431701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4563e0-f953-4436-a233-750c592b7cc4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.438607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f2c51-6178-440a-a4a0-f763cd410653 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7f7f2c51-6178-440a-a4a0-f763cd410653 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:42.444907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:42.446310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:42.447148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:42.451619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 152/310] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:42.453365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2c51-6178-440a-a4a0-f763cd410653 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.571374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2c51-6178-440a-a4a0-f763cd410653 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.581099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4563e0-f953-4436-a233-750c592b7cc4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.615025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:42.622518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.623535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.624554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.624554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.624796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:42.625068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.626507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.628568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.630665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.630665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.630665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.630665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:42.630958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.632055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.637919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 153/311] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:42.643842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.650219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 159/312] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:42.653104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.691341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:42.767640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb5f92-8fd9-4233-a5d6-014776d27dd8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.774822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f10ae-944c-4e26-bfbb-26d4cef8bb4a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.804880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146672-df07-40ca-ba07-d78e997bc686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.805715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146672-df07-40ca-ba07-d78e997bc686 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.806121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146672-df07-40ca-ba07-d78e997bc686 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.806491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8146672-df07-40ca-ba07-d78e997bc686 None admin] PATH_INFO: `/v3/users/d98122a2058449729d013c5b5ffbf609` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.807748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8146672-df07-40ca-ba07-d78e997bc686 None admin] RBAC: Authorizing `identity:get_user(user_id=d98122a2058449729d013c5b5ffbf609)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.809353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8146672-df07-40ca-ba07-d78e997bc686 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.811400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 160/313] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:42 2022] GET /identity/v3/users/d98122a2058449729d013c5b5ffbf609 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:42.816950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146672-df07-40ca-ba07-d78e997bc686 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.821098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9627283-b671-4f3e-af61-76eb732c02ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.822873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627283-b671-4f3e-af61-76eb732c02ce None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.823318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627283-b671-4f3e-af61-76eb732c02ce None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.823721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9627283-b671-4f3e-af61-76eb732c02ce None admin] PATH_INFO: `/v3/users/45aee29306ba41fd86284e9723b671c9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.825056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9627283-b671-4f3e-af61-76eb732c02ce None admin] RBAC: Authorizing `identity:get_user(user_id=45aee29306ba41fd86284e9723b671c9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.826674 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9627283-b671-4f3e-af61-76eb732c02ce None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.829320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 154/314] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:42 2022] GET /identity/v3/users/45aee29306ba41fd86284e9723b671c9 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:42.837561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9627283-b671-4f3e-af61-76eb732c02ce None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:42.883006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:42.933490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8146672-df07-40ca-ba07-d78e997bc686 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.968914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6100f3-2204-453b-b9fb-8858f38a9b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:42.969686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6100f3-2204-453b-b9fb-8858f38a9b83 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:42.970047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6100f3-2204-453b-b9fb-8858f38a9b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:42.970384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6100f3-2204-453b-b9fb-8858f38a9b83 None admin] PATH_INFO: `/v3/system/users/d98122a2058449729d013c5b5ffbf609/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:42.970763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9627283-b671-4f3e-af61-76eb732c02ce None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:42.971931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6100f3-2204-453b-b9fb-8858f38a9b83 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d98122a2058449729d013c5b5ffbf609, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:42.973400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6100f3-2204-453b-b9fb-8858f38a9b83 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:42.978614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:43.002254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 161/315] 10.222.0.48 () {58 vars in 1334 bytes} [Sat Sep 17 03:23:42 2022] PUT /identity/v3/system/users/d98122a2058449729d013c5b5ffbf609/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:23:43.009491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38fbf2-ea55-47c9-9829-79c4b1cb42ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:43.010181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38fbf2-ea55-47c9-9829-79c4b1cb42ef None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:43.010464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38fbf2-ea55-47c9-9829-79c4b1cb42ef None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:43.010737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e38fbf2-ea55-47c9-9829-79c4b1cb42ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:43.088809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38fbf2-ea55-47c9-9829-79c4b1cb42ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:43.090384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e38fbf2-ea55-47c9-9829-79c4b1cb42ef None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:43.202540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 155/316] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:43.208156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6100f3-2204-453b-b9fb-8858f38a9b83 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:43.313621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6100f3-2204-453b-b9fb-8858f38a9b83 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:43.336502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:43.348982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77076e08-209f-4f58-87aa-a338300f5ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:43.349994 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77076e08-209f-4f58-87aa-a338300f5ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:43.350272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77076e08-209f-4f58-87aa-a338300f5ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:43.350541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77076e08-209f-4f58-87aa-a338300f5ae5 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:43.351939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77076e08-209f-4f58-87aa-a338300f5ae5 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:43.353468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77076e08-209f-4f58-87aa-a338300f5ae5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:43.358096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 162/317] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:43 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:43.361771 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38fbf2-ea55-47c9-9829-79c4b1cb42ef None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:43.373742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:43.472653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e38fbf2-ea55-47c9-9829-79c4b1cb42ef None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:43.509797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd776c-37ff-4d36-94f7-18273311fd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:43.510755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd776c-37ff-4d36-94f7-18273311fd45 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:43.511218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd776c-37ff-4d36-94f7-18273311fd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:43.511776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd776c-37ff-4d36-94f7-18273311fd45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:43.512754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd776c-37ff-4d36-94f7-18273311fd45 None admin] RBAC: Adding query filter params (role.id=0d6ecd5695f44214b3d13ce911b051a1, scope.project.id=eadce91e10de414c90dbb6670817c373, user.id=45aee29306ba41fd86284e9723b671c9) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:43.513292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd776c-37ff-4d36-94f7-18273311fd45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:43.515311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd776c-37ff-4d36-94f7-18273311fd45 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:43.522052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 156/318] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:23:43 2022] GET /identity/v3/role_assignments?user.id=45aee29306ba41fd86284e9723b671c9&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=0d6ecd5695f44214b3d13ce911b051a1 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:44.508843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0499e16-2325-4eca-a182-d4694476d212 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:44.509427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0499e16-2325-4eca-a182-d4694476d212 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:44.509427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0499e16-2325-4eca-a182-d4694476d212 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:44.510933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 163/319] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:44.519875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0fb8d-0acc-4ca3-901f-c74c5881a73f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:44.520313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0fb8d-0acc-4ca3-901f-c74c5881a73f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:44.520386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed0fb8d-0acc-4ca3-901f-c74c5881a73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:44.540414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9ed0fb8d-0acc-4ca3-901f-c74c5881a73f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:44.541610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9ed0fb8d-0acc-4ca3-901f-c74c5881a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:44.616399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:44.625920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 157/320] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:44.741435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211882-d091-497a-948c-0ec4b7ca3e91 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:44.741809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211882-d091-497a-948c-0ec4b7ca3e91 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:44.741989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab211882-d091-497a-948c-0ec4b7ca3e91 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:44.743580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 164/321] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:44.748780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94053f5d-630f-4f0e-85b8-42c655e0f732 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:44.749069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94053f5d-630f-4f0e-85b8-42c655e0f732 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:44.749373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94053f5d-630f-4f0e-85b8-42c655e0f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:44.768499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-94053f5d-630f-4f0e-85b8-42c655e0f732 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:44.769594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-94053f5d-630f-4f0e-85b8-42c655e0f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:44.837247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 158/322] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:44.882658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab211882-d091-497a-948c-0ec4b7ca3e91 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:44.996548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab211882-d091-497a-948c-0ec4b7ca3e91 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:45.030810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1130644-5112-44e0-8549-5af94c1ec3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:45.031364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1130644-5112-44e0-8549-5af94c1ec3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.031635 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1130644-5112-44e0-8549-5af94c1ec3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.031898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1130644-5112-44e0-8549-5af94c1ec3a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.042076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1130644-5112-44e0-8549-5af94c1ec3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c1130644-5112-44e0-8549-5af94c1ec3a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:45.047272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:45.048164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:45.048986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 165/323] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:45.054146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94053f5d-630f-4f0e-85b8-42c655e0f732 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:45.100591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1130644-5112-44e0-8549-5af94c1ec3a2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:45.156300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:45.167770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94053f5d-630f-4f0e-85b8-42c655e0f732 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:45.202822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:45.207629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1130644-5112-44e0-8549-5af94c1ec3a2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:45.209239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9458173-c8bc-41c8-a336-99145e59faf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:45.212216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458173-c8bc-41c8-a336-99145e59faf2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.212216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458173-c8bc-41c8-a336-99145e59faf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.212216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9458173-c8bc-41c8-a336-99145e59faf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.212615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9458173-c8bc-41c8-a336-99145e59faf2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:45.212932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9458173-c8bc-41c8-a336-99145e59faf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:45.214390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9458173-c8bc-41c8-a336-99145e59faf2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:45.223337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 159/324] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:45.224676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d55bd-592b-481d-9500-ceed0b8ff6c5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.224961 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d55bd-592b-481d-9500-ceed0b8ff6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.225229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d55bd-592b-481d-9500-ceed0b8ff6c5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.226531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 160/325] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:45.228879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d55bd-592b-481d-9500-ceed0b8ff6c5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:45.247230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37030b33-02ed-43bf-955d-ecdd376d6adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:45.247853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030b33-02ed-43bf-955d-ecdd376d6adb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.248131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030b33-02ed-43bf-955d-ecdd376d6adb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.248401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37030b33-02ed-43bf-955d-ecdd376d6adb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.249507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37030b33-02ed-43bf-955d-ecdd376d6adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:45.250994 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37030b33-02ed-43bf-955d-ecdd376d6adb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:45.252572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 166/326] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:23:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:45.255025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842890ff-adcd-47d9-be4b-bc7c38a44bed None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.255380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842890ff-adcd-47d9-be4b-bc7c38a44bed None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.255665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842890ff-adcd-47d9-be4b-bc7c38a44bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.274475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-842890ff-adcd-47d9-be4b-bc7c38a44bed None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:45.275735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-842890ff-adcd-47d9-be4b-bc7c38a44bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:45.337484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d55bd-592b-481d-9500-ceed0b8ff6c5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:45.349932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 167/327] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:45.350582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842890ff-adcd-47d9-be4b-bc7c38a44bed None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:45.371645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb52a-39c7-4025-b63d-1652657d2f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:45.372387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb52a-39c7-4025-b63d-1652657d2f9b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.372658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb52a-39c7-4025-b63d-1652657d2f9b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.372925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cb52a-39c7-4025-b63d-1652657d2f9b None admin] PATH_INFO: `/v3/users/da0324ca252c43e89c54a2a3f56a143e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.374084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb52a-39c7-4025-b63d-1652657d2f9b None admin] RBAC: Authorizing `identity:get_user(user_id=da0324ca252c43e89c54a2a3f56a143e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:45.375764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cb52a-39c7-4025-b63d-1652657d2f9b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:45.382179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 161/328] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:45 2022] GET /identity/v3/users/da0324ca252c43e89c54a2a3f56a143e => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:45.383045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb52a-39c7-4025-b63d-1652657d2f9b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:45.399088 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:45.443273 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:45.451811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842890ff-adcd-47d9-be4b-bc7c38a44bed None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:45.484171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cb52a-39c7-4025-b63d-1652657d2f9b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:45.488691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cbfa7-49b4-497d-b471-3ca78dc35984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:45.489310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cbfa7-49b4-497d-b471-3ca78dc35984 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.489586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cbfa7-49b4-497d-b471-3ca78dc35984 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.489897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40cbfa7-49b4-497d-b471-3ca78dc35984 None admin] PATH_INFO: `/v3/groups` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.490529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cbfa7-49b4-497d-b471-3ca78dc35984 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:45.492487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40cbfa7-49b4-497d-b471-3ca78dc35984 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:45.509793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 168/329] 10.222.0.48 () {60 vars in 1134 bytes} [Sat Sep 17 03:23:45 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:23:45.524228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1d83d-eaca-4d65-9750-bfff550f9eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:45.525220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d83d-eaca-4d65-9750-bfff550f9eaf None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.525587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d83d-eaca-4d65-9750-bfff550f9eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.525985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f1d83d-eaca-4d65-9750-bfff550f9eaf None admin] PATH_INFO: `/v3/system/users/da0324ca252c43e89c54a2a3f56a143e/roles/0d6ecd5695f44214b3d13ce911b051a1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.527647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1d83d-eaca-4d65-9750-bfff550f9eaf None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=da0324ca252c43e89c54a2a3f56a143e, role_id=0d6ecd5695f44214b3d13ce911b051a1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:45.529292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f1d83d-eaca-4d65-9750-bfff550f9eaf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:45.539937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 162/330] 10.222.0.48 () {58 vars in 1334 bytes} [Sat Sep 17 03:23:45 2022] PUT /identity/v3/system/users/da0324ca252c43e89c54a2a3f56a143e/roles/0d6ecd5695f44214b3d13ce911b051a1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:45.615103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cbfa7-49b4-497d-b471-3ca78dc35984 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:45.735131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40cbfa7-49b4-497d-b471-3ca78dc35984 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:45.744524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:45.770189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac3235-2eb5-4d52-8d49-5412eb86f26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:45.770823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac3235-2eb5-4d52-8d49-5412eb86f26d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.771096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac3235-2eb5-4d52-8d49-5412eb86f26d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.771358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac3235-2eb5-4d52-8d49-5412eb86f26d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.781299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac3235-2eb5-4d52-8d49-5412eb86f26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-87ac3235-2eb5-4d52-8d49-5412eb86f26d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:45.786565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:45.787617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:45.788555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:45.792508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 169/331] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:45.793936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1d83d-eaca-4d65-9750-bfff550f9eaf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:45.903038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f1d83d-eaca-4d65-9750-bfff550f9eaf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:45.928590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:45.943400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:45.944126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:45.944405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:45.944671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:45.945401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:45.945696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:45.947184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:45.957924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 163/332] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:45.963477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac3235-2eb5-4d52-8d49-5412eb86f26d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:46.079984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac3235-2eb5-4d52-8d49-5412eb86f26d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:46.117068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644e65-217f-4e97-8c0a-0079fd2c1b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:46.117704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644e65-217f-4e97-8c0a-0079fd2c1b7f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:46.118015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644e65-217f-4e97-8c0a-0079fd2c1b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:46.118281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644e65-217f-4e97-8c0a-0079fd2c1b7f None admin] PATH_INFO: `/v3/users/d98122a2058449729d013c5b5ffbf609` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:46.119397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644e65-217f-4e97-8c0a-0079fd2c1b7f None admin] RBAC: Authorizing `identity:get_user(user_id=d98122a2058449729d013c5b5ffbf609)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:46.120832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644e65-217f-4e97-8c0a-0079fd2c1b7f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:46.122622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 170/333] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:45 2022] GET /identity/v3/users/d98122a2058449729d013c5b5ffbf609 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:46.128300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:46.231795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220a1ae-d677-464f-adfe-60ce561a1c95 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:46.272128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf771140-3599-4f44-a2ec-acfa19f48a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:46.273170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf771140-3599-4f44-a2ec-acfa19f48a26 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:46.273724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf771140-3599-4f44-a2ec-acfa19f48a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:46.274238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf771140-3599-4f44-a2ec-acfa19f48a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:46.275550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf771140-3599-4f44-a2ec-acfa19f48a26 None admin] RBAC: Adding query filter params (role.id=d907003acd2748ac99d722b1aea4288a, user.id=d98122a2058449729d013c5b5ffbf609, scope.system=all) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:46.276098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf771140-3599-4f44-a2ec-acfa19f48a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:46.278068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf771140-3599-4f44-a2ec-acfa19f48a26 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:46.291549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 164/334] 10.222.0.48 () {56 vars in 1308 bytes} [Sat Sep 17 03:23:46 2022] GET /identity/v3/role_assignments?user.id=d98122a2058449729d013c5b5ffbf609&scope.system=all&role.id=d907003acd2748ac99d722b1aea4288a => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:47.806071 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329c68b-ddc6-43c8-ba7a-cc0b0e42d1cd None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:47.806589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329c68b-ddc6-43c8-ba7a-cc0b0e42d1cd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:47.806589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329c68b-ddc6-43c8-ba7a-cc0b0e42d1cd None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:47.808312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 171/335] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:47.814238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4f91a-55ab-425f-a38d-b60e3fa8d1af None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:47.814686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4f91a-55ab-425f-a38d-b60e3fa8d1af None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:47.814759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4f91a-55ab-425f-a38d-b60e3fa8d1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:47.840961 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d4d4f91a-55ab-425f-a38d-b60e3fa8d1af None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:47.842184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d4d4f91a-55ab-425f-a38d-b60e3fa8d1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:47.884908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:47.913689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 165/336] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:48.338765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1cbb2-22b1-424c-b810-0c975e3fe768 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:48.339040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1cbb2-22b1-424c-b810-0c975e3fe768 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:48.339589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1cbb2-22b1-424c-b810-0c975e3fe768 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:48.341479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 172/337] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:48.355763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554f31c-eada-4ed2-868a-c45404191313 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:48.356354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554f31c-eada-4ed2-868a-c45404191313 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:48.356812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554f31c-eada-4ed2-868a-c45404191313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:48.382812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6554f31c-eada-4ed2-868a-c45404191313 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:48.384325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6554f31c-eada-4ed2-868a-c45404191313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:48.461673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 166/338] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:48.466980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948635c-a95b-4325-b007-d8cb90050270 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:48.467479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948635c-a95b-4325-b007-d8cb90050270 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:48.467982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e948635c-a95b-4325-b007-d8cb90050270 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:48.469491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 173/339] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:48.470636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554f31c-eada-4ed2-868a-c45404191313 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:48.474689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6be5b-af55-41ea-b613-d85a3d737e14 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:48.475186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6be5b-af55-41ea-b613-d85a3d737e14 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:48.475642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6be5b-af55-41ea-b613-d85a3d737e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:48.507688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c9e6be5b-af55-41ea-b613-d85a3d737e14 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:48.509902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c9e6be5b-af55-41ea-b613-d85a3d737e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:48.566162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:48.632256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 174/340] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 17 03:23:48.660405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554f31c-eada-4ed2-868a-c45404191313 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:48.662829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:48.706356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd67732-8305-41da-ab00-fc6d87ff05b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:48.707015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd67732-8305-41da-ab00-fc6d87ff05b9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:48.707295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd67732-8305-41da-ab00-fc6d87ff05b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:48.707564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd67732-8305-41da-ab00-fc6d87ff05b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:48.723110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd67732-8305-41da-ab00-fc6d87ff05b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-4fd67732-8305-41da-ab00-fc6d87ff05b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:48.728031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:48.728894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:48.729694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 167/341] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:48.736823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6be5b-af55-41ea-b613-d85a3d737e14 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:48.867718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6be5b-af55-41ea-b613-d85a3d737e14 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:48.913206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:48.914264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:48.914735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:48.915195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:48.916076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:48.916563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:48.918146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:48.926295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd67732-8305-41da-ab00-fc6d87ff05b9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:48.934726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 175/342] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:48.943059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:48.974949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:49.056235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4781cf-3fa1-4530-95ea-71006b913445 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:49.097155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82d12a-f38f-4a71-817c-22be91195cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:49.098060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82d12a-f38f-4a71-817c-22be91195cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.098501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82d12a-f38f-4a71-817c-22be91195cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.098909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd82d12a-f38f-4a71-817c-22be91195cb8 None admin] PATH_INFO: `/v3/users/da0324ca252c43e89c54a2a3f56a143e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.106525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82d12a-f38f-4a71-817c-22be91195cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=da0324ca252c43e89c54a2a3f56a143e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:49.108203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd82d12a-f38f-4a71-817c-22be91195cb8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:49.110302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 176/343] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:23:48 2022] GET /identity/v3/users/da0324ca252c43e89c54a2a3f56a143e => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:49.122667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82d12a-f38f-4a71-817c-22be91195cb8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:49.135278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd67732-8305-41da-ab00-fc6d87ff05b9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:49.207127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a144d-15b9-49d9-abfd-906ec6a4385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:49.208004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a144d-15b9-49d9-abfd-906ec6a4385d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.208423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a144d-15b9-49d9-abfd-906ec6a4385d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.208852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a144d-15b9-49d9-abfd-906ec6a4385d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.232187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a144d-15b9-49d9-abfd-906ec6a4385d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-494a144d-15b9-49d9-abfd-906ec6a4385d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:49.237310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:49.238437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:49.239435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:49.240204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:49.244834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 168/344] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:49.245887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a144d-15b9-49d9-abfd-906ec6a4385d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:49.250345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd82d12a-f38f-4a71-817c-22be91195cb8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:49.288664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:49.289339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.289673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.289996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.290794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] RBAC: Adding query filter params (role.id=0d6ecd5695f44214b3d13ce911b051a1, user.id=da0324ca252c43e89c54a2a3f56a143e, scope.system=all) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:49.291106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:49.292567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:49.305725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 177/345] 10.222.0.48 () {56 vars in 1308 bytes} [Sat Sep 17 03:23:49 2022] GET /identity/v3/role_assignments?user.id=da0324ca252c43e89c54a2a3f56a143e&scope.system=all&role.id=0d6ecd5695f44214b3d13ce911b051a1 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:49.306564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:49.315045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:49.423601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba7ae6-917a-42dd-a4d6-a40c076f2adb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:49.484831 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c59851-4eb5-4504-9241-3c948b346bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:49.485383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59851-4eb5-4504-9241-3c948b346bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.485660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59851-4eb5-4504-9241-3c948b346bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.485950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c59851-4eb5-4504-9241-3c948b346bf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.486637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c59851-4eb5-4504-9241-3c948b346bf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:49.486933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c59851-4eb5-4504-9241-3c948b346bf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:49.488326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c59851-4eb5-4504-9241-3c948b346bf1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:49.496426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a144d-15b9-49d9-abfd-906ec6a4385d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:49.511796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 178/346] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:49.513103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019bb6-dcc4-4c98-8d8f-f86c70de86c2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.513382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019bb6-dcc4-4c98-8d8f-f86c70de86c2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.514017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25019bb6-dcc4-4c98-8d8f-f86c70de86c2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.515261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 179/347] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:49.520371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019bb6-dcc4-4c98-8d8f-f86c70de86c2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:49.562366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:49.575854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb28a16-13cc-462c-886d-9fc4a9b0d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:49.576506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28a16-13cc-462c-886d-9fc4a9b0d4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.576778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28a16-13cc-462c-886d-9fc4a9b0d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.577100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb28a16-13cc-462c-886d-9fc4a9b0d4b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.594244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb28a16-13cc-462c-886d-9fc4a9b0d4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bcb28a16-13cc-462c-886d-9fc4a9b0d4b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:49.599683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:49.600615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:49.601500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:49.603970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 169/348] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:49.605681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c889-21fa-4ef8-ab11-e6ac4a6788bc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.606144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c889-21fa-4ef8-ab11-e6ac4a6788bc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.606419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623c889-21fa-4ef8-ab11-e6ac4a6788bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.630850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6623c889-21fa-4ef8-ab11-e6ac4a6788bc None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:49.632084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6623c889-21fa-4ef8-ab11-e6ac4a6788bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:49.723947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 170/349] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:49.725043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c889-21fa-4ef8-ab11-e6ac4a6788bc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:49.734397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25019bb6-dcc4-4c98-8d8f-f86c70de86c2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:49.741786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:49.786285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486c599-af9c-4300-affc-c430a577e4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:49.787156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486c599-af9c-4300-affc-c430a577e4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.787578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486c599-af9c-4300-affc-c430a577e4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.787986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486c599-af9c-4300-affc-c430a577e4e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.895311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486c599-af9c-4300-affc-c430a577e4e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:49.897789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486c599-af9c-4300-affc-c430a577e4e4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:49.914488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623c889-21fa-4ef8-ab11-e6ac4a6788bc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:49.918263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:49.987851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:49.988480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:49.988757 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:49.989026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:49.990074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:49.990074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:49.992391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:50.012158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 171/350] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:50.022822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:50.073111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 180/351] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:50.074809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486c599-af9c-4300-affc-c430a577e4e4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:50.119789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:50.144906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92444c8f-1b31-4a26-a44d-bdb36f8f9968 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:50.184740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ebe75d-1fb0-4218-8b3a-f69ed43a402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:50.185392 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe75d-1fb0-4218-8b3a-f69ed43a402d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.185688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe75d-1fb0-4218-8b3a-f69ed43a402d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.186016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ebe75d-1fb0-4218-8b3a-f69ed43a402d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.194323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486c599-af9c-4300-affc-c430a577e4e4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:50.214792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:50.241424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a98824-3e7f-44cd-9f5a-c4c222255906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:50.242684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98824-3e7f-44cd-9f5a-c4c222255906 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.242901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98824-3e7f-44cd-9f5a-c4c222255906 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.243172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a98824-3e7f-44cd-9f5a-c4c222255906 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.258310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a98824-3e7f-44cd-9f5a-c4c222255906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-89a98824-3e7f-44cd-9f5a-c4c222255906 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:50.263454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:50.264762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:50.265555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 181/352] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:50.266293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91d38-7aff-4859-a050-697c174cff3b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.266293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91d38-7aff-4859-a050-697c174cff3b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.266422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f91d38-7aff-4859-a050-697c174cff3b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.268318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 182/353] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:50.268864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91d38-7aff-4859-a050-697c174cff3b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:50.280825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebe75d-1fb0-4218-8b3a-f69ed43a402d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:50.282454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ebe75d-1fb0-4218-8b3a-f69ed43a402d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:50.380114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:50.412553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f91d38-7aff-4859-a050-697c174cff3b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:50.412749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 172/354] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:50.414685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ea80-1842-44bc-b45b-c53e52732db1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.414973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ea80-1842-44bc-b45b-c53e52732db1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.415272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a80ea80-1842-44bc-b45b-c53e52732db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.438813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2a80ea80-1842-44bc-b45b-c53e52732db1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:50.440617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2a80ea80-1842-44bc-b45b-c53e52732db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:50.457635 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0317-253d-4f00-a12f-dc2177575491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:50.458561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0317-253d-4f00-a12f-dc2177575491 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.460534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0317-253d-4f00-a12f-dc2177575491 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.460534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b0317-253d-4f00-a12f-dc2177575491 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.461269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b0317-253d-4f00-a12f-dc2177575491 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:50.462858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858b0317-253d-4f00-a12f-dc2177575491 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:50.464714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 183/355] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:50 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:50.465679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0317-253d-4f00-a12f-dc2177575491 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:50.529607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 173/356] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:50.530484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ea80-1842-44bc-b45b-c53e52732db1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:50.535222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:50.603181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858b0317-253d-4f00-a12f-dc2177575491 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:50.641062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:50.641679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.641996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.642272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.642973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:50.643335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:50.644741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:50.653630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 184/357] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:50.655210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:50.663850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a80ea80-1842-44bc-b45b-c53e52732db1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:50.674489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:50.712612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84990f8-b981-4f0b-af7d-11605d4fca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:50.713259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84990f8-b981-4f0b-af7d-11605d4fca82 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.713539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84990f8-b981-4f0b-af7d-11605d4fca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.713839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84990f8-b981-4f0b-af7d-11605d4fca82 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.714964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84990f8-b981-4f0b-af7d-11605d4fca82 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:50.716487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84990f8-b981-4f0b-af7d-11605d4fca82 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:50.718197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 174/358] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:50 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:50.718996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84990f8-b981-4f0b-af7d-11605d4fca82 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:50.777338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e2c0e-8432-43de-bbd5-26ad0f26b070 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:50.785585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:50.828934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574b18cb-549b-4083-bcbc-56be6888bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:50.829577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b18cb-549b-4083-bcbc-56be6888bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.829882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b18cb-549b-4083-bcbc-56be6888bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.830156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574b18cb-549b-4083-bcbc-56be6888bfa9 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.838183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84990f8-b981-4f0b-af7d-11605d4fca82 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:50.838343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b18cb-549b-4083-bcbc-56be6888bfa9 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:50.839755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574b18cb-549b-4083-bcbc-56be6888bfa9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:50.841420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 185/359] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:50 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:50.843202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e0c86-e0c4-4e39-9cd4-34273ec2fda1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.843500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e0c86-e0c4-4e39-9cd4-34273ec2fda1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.843749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e0c86-e0c4-4e39-9cd4-34273ec2fda1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.845060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 186/360] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:50.849515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e0c86-e0c4-4e39-9cd4-34273ec2fda1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:50.873628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305cc15-aaa0-464e-87e6-235fb361f4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:50.874305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305cc15-aaa0-464e-87e6-235fb361f4af None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.874602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305cc15-aaa0-464e-87e6-235fb361f4af None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.874865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305cc15-aaa0-464e-87e6-235fb361f4af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:50.923288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:50.953673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305cc15-aaa0-464e-87e6-235fb361f4af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:50.955191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305cc15-aaa0-464e-87e6-235fb361f4af None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:50.957780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e0c86-e0c4-4e39-9cd4-34273ec2fda1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:50.998469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673c53-ce5b-43fa-b1ee-a23d96a40185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:50.999114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673c53-ce5b-43fa-b1ee-a23d96a40185 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:50.999412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673c53-ce5b-43fa-b1ee-a23d96a40185 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:50.999682 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8673c53-ce5b-43fa-b1ee-a23d96a40185 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.001231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8673c53-ce5b-43fa-b1ee-a23d96a40185 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:51.003065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8673c53-ce5b-43fa-b1ee-a23d96a40185 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:51.004983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 187/361] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:50 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:51.005905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673c53-ce5b-43fa-b1ee-a23d96a40185 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.052227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:51.074548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 175/362] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:51.075055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305cc15-aaa0-464e-87e6-235fb361f4af None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.133817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8673c53-ce5b-43fa-b1ee-a23d96a40185 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:51.155365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:51.174520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b899624-e073-4df7-9362-7ffd545d9c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:51.175033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b899624-e073-4df7-9362-7ffd545d9c54 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.175306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b899624-e073-4df7-9362-7ffd545d9c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.176118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b899624-e073-4df7-9362-7ffd545d9c54 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.186047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b899624-e073-4df7-9362-7ffd545d9c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:51.189410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305cc15-aaa0-464e-87e6-235fb361f4af None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6b899624-e073-4df7-9362-7ffd545d9c54 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:51.191333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:51.192205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:51.193398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 188/363] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:51.194391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eec93-7553-4bd4-83ee-04a2e163708e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.194391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eec93-7553-4bd4-83ee-04a2e163708e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.194391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eec93-7553-4bd4-83ee-04a2e163708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.214245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b68eec93-7553-4bd4-83ee-04a2e163708e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:51.215852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b68eec93-7553-4bd4-83ee-04a2e163708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:51.232527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:51.233154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.233431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.233702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.234602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] RBAC: Adding query filter params (group.id=c00117d71b57479bb0a59ba21081ed93, role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:51.234901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:51.236354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:51.242693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 176/364] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/role_assignments?group.id=c00117d71b57479bb0a59ba21081ed93&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=caea830f617d461ca08b1b747e2500a1 => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:51.243520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.308991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 189/365] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:51.310866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68eec93-7553-4bd4-83ee-04a2e163708e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.342986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:51.380715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea3d00-744f-4ef8-af25-e959bad69b5d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:51.426590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:51.427491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.427770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.428038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.428955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] RBAC: Adding query filter params (group.id=c00117d71b57479bb0a59ba21081ed93, role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:51.429255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:51.431491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:51.432550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68eec93-7553-4bd4-83ee-04a2e163708e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:51.438843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 177/366] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/role_assignments?group.id=c00117d71b57479bb0a59ba21081ed93&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=d907003acd2748ac99d722b1aea4288a => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:51.439982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.450180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:51.485942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df6c0-7b9a-4895-919c-c0d5bd6d6228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:51.486584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df6c0-7b9a-4895-919c-c0d5bd6d6228 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.486857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df6c0-7b9a-4895-919c-c0d5bd6d6228 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.487128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153df6c0-7b9a-4895-919c-c0d5bd6d6228 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.488299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153df6c0-7b9a-4895-919c-c0d5bd6d6228 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:51.489797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153df6c0-7b9a-4895-919c-c0d5bd6d6228 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:51.492899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 190/367] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:51.501947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df6c0-7b9a-4895-919c-c0d5bd6d6228 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.560587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2f63-a868-4aa7-b63c-7258ebe1812f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:51.630231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:51.631156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.632662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.633093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.634964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:51.635458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:51.637078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:51.647923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 178/368] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:51.655874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.681152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:51.687817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153df6c0-7b9a-4895-919c-c0d5bd6d6228 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:51.729193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcb0c-7b5c-4785-8a97-e08a257e7ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:51.729862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcb0c-7b5c-4785-8a97-e08a257e7ffb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.730137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcb0c-7b5c-4785-8a97-e08a257e7ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.730405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dfcb0c-7b5c-4785-8a97-e08a257e7ffb None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.731503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcb0c-7b5c-4785-8a97-e08a257e7ffb None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:51.732940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dfcb0c-7b5c-4785-8a97-e08a257e7ffb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:51.734873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 191/369] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:51.735641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcb0c-7b5c-4785-8a97-e08a257e7ffb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.750855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:51.799200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c213e1-b7d9-42b3-9b4a-333eae853fc9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:51.836256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ae41-cecd-47fe-81be-7ac381f47b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:51.837198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ae41-cecd-47fe-81be-7ac381f47b95 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.837623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ae41-cecd-47fe-81be-7ac381f47b95 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.838051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ae41-cecd-47fe-81be-7ac381f47b95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.849544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768ae41-cecd-47fe-81be-7ac381f47b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:51.850748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dfcb0c-7b5c-4785-8a97-e08a257e7ffb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6768ae41-cecd-47fe-81be-7ac381f47b95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:51.855604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:51.856701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:51.857669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:51.859935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 179/370] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:51.860973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ae41-cecd-47fe-81be-7ac381f47b95 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:51.888204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c86f-95a9-4b09-b607-9db1b6ea2775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:51.889178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c86f-95a9-4b09-b607-9db1b6ea2775 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:51.889449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c86f-95a9-4b09-b607-9db1b6ea2775 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:51.889715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3c86f-95a9-4b09-b607-9db1b6ea2775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:51.923957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:51.964048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c86f-95a9-4b09-b607-9db1b6ea2775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:51.965652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3c86f-95a9-4b09-b607-9db1b6ea2775 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:51.972002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ae41-cecd-47fe-81be-7ac381f47b95 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:52.001284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:52.014261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:52.015219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:52.015714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:52.016171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:52.017144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] RBAC: Adding query filter params (group.id=c00117d71b57479bb0a59ba21081ed93, role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=eadce91e10de414c90dbb6670817c373) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:52.017664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:52.019402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:52.025846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 180/371] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/role_assignments?group.id=c00117d71b57479bb0a59ba21081ed93&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=d907003acd2748ac99d722b1aea4288a => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:52.026959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:52.089035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 192/372] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:52.094738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c86f-95a9-4b09-b607-9db1b6ea2775 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:52.147588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60e617-fbea-45a6-9373-6a23f6b74bc0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:52.175515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:52.199235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:52.200279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:52.200750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:52.201235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:52.202185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:52.202684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:52.204331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:52.211166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3c86f-95a9-4b09-b607-9db1b6ea2775 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:52.217699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 181/373] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:52.224010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:52.252101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d1f80-27b9-404c-9d42-fb3174dfb5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:52.252636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1f80-27b9-404c-9d42-fb3174dfb5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:52.252914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1f80-27b9-404c-9d42-fb3174dfb5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:52.253186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d1f80-27b9-404c-9d42-fb3174dfb5f5 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:52.254384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d1f80-27b9-404c-9d42-fb3174dfb5f5 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:52.255847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d1f80-27b9-404c-9d42-fb3174dfb5f5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:52.259220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 193/374] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:52 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:52.265315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d1f80-27b9-404c-9d42-fb3174dfb5f5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:52.286236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:52.345680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470b8f2-486f-4d91-8661-05a3054e9b96 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:52.410678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab5aef-ce5f-4ba2-9c88-dfcdae6a7060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:52.411564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab5aef-ce5f-4ba2-9c88-dfcdae6a7060 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:52.412140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab5aef-ce5f-4ba2-9c88-dfcdae6a7060 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:52.413854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab5aef-ce5f-4ba2-9c88-dfcdae6a7060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:52.443013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d1f80-27b9-404c-9d42-fb3174dfb5f5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:52.490685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:52.495566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df192f6-fa2d-493e-a5df-38f0b2802495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:52.497193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df192f6-fa2d-493e-a5df-38f0b2802495 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:52.497717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df192f6-fa2d-493e-a5df-38f0b2802495 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:52.499039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df192f6-fa2d-493e-a5df-38f0b2802495 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:52.501397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df192f6-fa2d-493e-a5df-38f0b2802495 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:52.504229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df192f6-fa2d-493e-a5df-38f0b2802495 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:52.509629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 194/375] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:52 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:52.515902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df192f6-fa2d-493e-a5df-38f0b2802495 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:52.541632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab5aef-ce5f-4ba2-9c88-dfcdae6a7060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:52.543481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab5aef-ce5f-4ba2-9c88-dfcdae6a7060 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:52.634926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:52.693253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df192f6-fa2d-493e-a5df-38f0b2802495 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:52.723894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 182/376] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:23:52.730715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab5aef-ce5f-4ba2-9c88-dfcdae6a7060 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:52.739017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:52.739816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:52.740300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:52.740760 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:52.741684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] RBAC: Adding query filter params (group.id=c00117d71b57479bb0a59ba21081ed93, role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=eadce91e10de414c90dbb6670817c373) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:52.742309 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:52.743941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:52.753980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 195/377] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:23:52 2022] GET /identity/v3/role_assignments?group.id=c00117d71b57479bb0a59ba21081ed93&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=caea830f617d461ca08b1b747e2500a1 => generated 260 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:52.889200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab5aef-ce5f-4ba2-9c88-dfcdae6a7060 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:52.935927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243012e-910d-491e-afa9-cee792a1dd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:52.937028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243012e-910d-491e-afa9-cee792a1dd72 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:52.937511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243012e-910d-491e-afa9-cee792a1dd72 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:52.938019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243012e-910d-491e-afa9-cee792a1dd72 None admin] PATH_INFO: `/v3/projects/04f74c924c074ea694d34911dde51343` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:52.939435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243012e-910d-491e-afa9-cee792a1dd72 None admin] RBAC: Authorizing `identity:get_project(project_id=04f74c924c074ea694d34911dde51343)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:52.941151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243012e-910d-491e-afa9-cee792a1dd72 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:52.943450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 183/378] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:52 2022] GET /identity/v3/projects/04f74c924c074ea694d34911dde51343 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:52.949128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:53.037223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:53.084806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c4fd-19f1-4c18-a966-daa02ac74e1c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:53.133682 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f46c6-4c69-4223-9ccb-53171e3a0f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:53.134772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f46c6-4c69-4223-9ccb-53171e3a0f40 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:53.135258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f46c6-4c69-4223-9ccb-53171e3a0f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:53.135751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f46c6-4c69-4223-9ccb-53171e3a0f40 None admin] PATH_INFO: `/v3/groups/dd02a75ad55e4da4b42ad41dbbb2e6b5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:53.141587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f46c6-4c69-4223-9ccb-53171e3a0f40 None admin] RBAC: Authorizing `identity:get_group(group_id=dd02a75ad55e4da4b42ad41dbbb2e6b5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:53.143352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f46c6-4c69-4223-9ccb-53171e3a0f40 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:53.145200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 196/379] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:52 2022] GET /identity/v3/groups/dd02a75ad55e4da4b42ad41dbbb2e6b5 => generated 229 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:53.151595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243012e-910d-491e-afa9-cee792a1dd72 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:53.174201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:53.275843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243012e-910d-491e-afa9-cee792a1dd72 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:53.319276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d79f4b-80cb-46bd-a332-f6d5d1a5ff71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:53.319895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79f4b-80cb-46bd-a332-f6d5d1a5ff71 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:53.320251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79f4b-80cb-46bd-a332-f6d5d1a5ff71 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:53.320526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d79f4b-80cb-46bd-a332-f6d5d1a5ff71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:53.321253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d79f4b-80cb-46bd-a332-f6d5d1a5ff71 None admin] RBAC: Adding query filter params (group.id=dd02a75ad55e4da4b42ad41dbbb2e6b5, role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=04f74c924c074ea694d34911dde51343) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:53.321558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d79f4b-80cb-46bd-a332-f6d5d1a5ff71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:53.323044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d79f4b-80cb-46bd-a332-f6d5d1a5ff71 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:53.334235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 184/380] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:23:53 2022] GET /identity/v3/role_assignments?group.id=dd02a75ad55e4da4b42ad41dbbb2e6b5&scope.project.id=04f74c924c074ea694d34911dde51343&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:53.954496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f861128-798d-4f57-83dd-09ca26946d80 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:53.955044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f861128-798d-4f57-83dd-09ca26946d80 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:53.955478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f861128-798d-4f57-83dd-09ca26946d80 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:53.957209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 197/381] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:53.963346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a708d6e-f4db-45ee-8860-232fc01c78a4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:53.963899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a708d6e-f4db-45ee-8860-232fc01c78a4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:53.964377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a708d6e-f4db-45ee-8860-232fc01c78a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:53.994379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9a708d6e-f4db-45ee-8860-232fc01c78a4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:53.995916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a708d6e-f4db-45ee-8860-232fc01c78a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:54.065513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 185/382] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:54.213385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268443fe-6d93-459b-86a5-c81fc5e0e5af None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:54.214351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268443fe-6d93-459b-86a5-c81fc5e0e5af None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:54.214838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268443fe-6d93-459b-86a5-c81fc5e0e5af None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:54.216462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 198/383] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:54.221735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189d45-b391-4c0e-abc6-f9faf6b4f9f4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:54.222621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189d45-b391-4c0e-abc6-f9faf6b4f9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:54.223150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb189d45-b391-4c0e-abc6-f9faf6b4f9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:54.247192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-eb189d45-b391-4c0e-abc6-f9faf6b4f9f4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:54.248716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-eb189d45-b391-4c0e-abc6-f9faf6b4f9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:54.257108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:54.332926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 186/384] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:54.391609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268443fe-6d93-459b-86a5-c81fc5e0e5af None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:54.543489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268443fe-6d93-459b-86a5-c81fc5e0e5af None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:54.575989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:54.587823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b7d09-b1bc-4f83-90e1-af6dd637ca84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:54.588473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b7d09-b1bc-4f83-90e1-af6dd637ca84 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:54.589096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b7d09-b1bc-4f83-90e1-af6dd637ca84 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:54.589372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b7d09-b1bc-4f83-90e1-af6dd637ca84 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:54.600472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b7d09-b1bc-4f83-90e1-af6dd637ca84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-eb0b7d09-b1bc-4f83-90e1-af6dd637ca84 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:54.605312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:54.606251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:54.607094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 199/385] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:54.613876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb189d45-b391-4c0e-abc6-f9faf6b4f9f4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:54.635318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b7d09-b1bc-4f83-90e1-af6dd637ca84 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:54.791764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb189d45-b391-4c0e-abc6-f9faf6b4f9f4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:54.802020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b7d09-b1bc-4f83-90e1-af6dd637ca84 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:54.852579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:54.853203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:54.853480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:54.853777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:54.854437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:54.854746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:54.856127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:54.859507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907666d-a9df-46dd-927e-a2277dce8e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:54.860154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907666d-a9df-46dd-927e-a2277dce8e93 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:54.860427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907666d-a9df-46dd-927e-a2277dce8e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:54.860689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907666d-a9df-46dd-927e-a2277dce8e93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:54.873126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 187/386] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:54.880604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:54.886356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907666d-a9df-46dd-927e-a2277dce8e93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e907666d-a9df-46dd-927e-a2277dce8e93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:54.892091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:54.892967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:54.893787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:54.895183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 200/387] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:23:54.895384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:54.905516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907666d-a9df-46dd-927e-a2277dce8e93 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:55.008817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:55.027925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c797f2-e65d-404a-8e0a-0e98662e351a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:55.069636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02692fbe-10f7-4c5d-b8fc-380d671f4557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:55.071430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692fbe-10f7-4c5d-b8fc-380d671f4557 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.071722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692fbe-10f7-4c5d-b8fc-380d671f4557 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.071987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02692fbe-10f7-4c5d-b8fc-380d671f4557 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.073189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02692fbe-10f7-4c5d-b8fc-380d671f4557 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:55.074696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02692fbe-10f7-4c5d-b8fc-380d671f4557 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:55.077133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 188/388] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:54 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:55.082539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02692fbe-10f7-4c5d-b8fc-380d671f4557 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:55.147904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907666d-a9df-46dd-927e-a2277dce8e93 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:55.160630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:55.199752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7491a1-f7e8-402e-87c0-042505f8ca8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:55.200488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7491a1-f7e8-402e-87c0-042505f8ca8f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.200773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7491a1-f7e8-402e-87c0-042505f8ca8f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.201049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7491a1-f7e8-402e-87c0-042505f8ca8f None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.201776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7491a1-f7e8-402e-87c0-042505f8ca8f None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:55.202072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7491a1-f7e8-402e-87c0-042505f8ca8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:55.203504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7491a1-f7e8-402e-87c0-042505f8ca8f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:55.207061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02692fbe-10f7-4c5d-b8fc-380d671f4557 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:55.214399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 201/389] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:55.215842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a93b-977f-4cf4-b8b4-9913cccfaf1f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.216127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a93b-977f-4cf4-b8b4-9913cccfaf1f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.216404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097a93b-977f-4cf4-b8b4-9913cccfaf1f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.221805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 202/390] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:55.221805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097a93b-977f-4cf4-b8b4-9913cccfaf1f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:55.257172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2af3f5-9d13-4226-b520-9d4317061c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:55.258744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2af3f5-9d13-4226-b520-9d4317061c2c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.260058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2af3f5-9d13-4226-b520-9d4317061c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.260530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2af3f5-9d13-4226-b520-9d4317061c2c None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.261914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2af3f5-9d13-4226-b520-9d4317061c2c None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:55.263957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2af3f5-9d13-4226-b520-9d4317061c2c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:55.271323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 189/391] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:55 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:55.271323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977be5-9f4b-4b9c-8b29-f978509502a5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.273023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977be5-9f4b-4b9c-8b29-f978509502a5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.273145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a977be5-9f4b-4b9c-8b29-f978509502a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.297114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9a977be5-9f4b-4b9c-8b29-f978509502a5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:55.298408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a977be5-9f4b-4b9c-8b29-f978509502a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:55.339660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097a93b-977f-4cf4-b8b4-9913cccfaf1f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:55.349875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:55.375798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b722e-0c15-48aa-94bd-c1f0504c25d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:55.376476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b722e-0c15-48aa-94bd-c1f0504c25d6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.376753 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b722e-0c15-48aa-94bd-c1f0504c25d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.377024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b722e-0c15-48aa-94bd-c1f0504c25d6 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.378168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b722e-0c15-48aa-94bd-c1f0504c25d6 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:55.379594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b722e-0c15-48aa-94bd-c1f0504c25d6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:55.381312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 203/392] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:55 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:55.381419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 190/393] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:55.382189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b722e-0c15-48aa-94bd-c1f0504c25d6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:55.383289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aa555-ce02-40da-b90f-1f9b067e5f34 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.383396 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aa555-ce02-40da-b90f-1f9b067e5f34 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.384301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376aa555-ce02-40da-b90f-1f9b067e5f34 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.386091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 191/394] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:55.390559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aa555-ce02-40da-b90f-1f9b067e5f34 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:55.469330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:55.503487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376aa555-ce02-40da-b90f-1f9b067e5f34 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:55.520716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b722e-0c15-48aa-94bd-c1f0504c25d6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:55.542177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a17aac-7789-44de-89f2-031913940743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:55.542945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a17aac-7789-44de-89f2-031913940743 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.543321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a17aac-7789-44de-89f2-031913940743 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.543699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a17aac-7789-44de-89f2-031913940743 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.545115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a17aac-7789-44de-89f2-031913940743 None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:55.546841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a17aac-7789-44de-89f2-031913940743 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:55.549028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 192/395] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:55 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:55.550418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c699-ded1-457a-977e-e5bd1c3fba36 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.550799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c699-ded1-457a-977e-e5bd1c3fba36 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.551165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c699-ded1-457a-977e-e5bd1c3fba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.560303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978efff-212c-489d-806b-6522eafcf6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:55.560961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978efff-212c-489d-806b-6522eafcf6db None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.561233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978efff-212c-489d-806b-6522eafcf6db None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.561500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978efff-212c-489d-806b-6522eafcf6db None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/groups/c00117d71b57479bb0a59ba21081ed93/roles/caea830f617d461ca08b1b747e2500a1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.563922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978efff-212c-489d-806b-6522eafcf6db None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd99e67c7d5401abc8f0c2d95e888a8, group_id=c00117d71b57479bb0a59ba21081ed93, role_id=caea830f617d461ca08b1b747e2500a1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:55.565399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978efff-212c-489d-806b-6522eafcf6db None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:55.572764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6ed0c699-ded1-457a-977e-e5bd1c3fba36 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:55.574160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6ed0c699-ded1-457a-977e-e5bd1c3fba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:55.583507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 204/396] 10.222.0.48 () {58 vars in 1442 bytes} [Sat Sep 17 03:23:55 2022] PUT /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/groups/c00117d71b57479bb0a59ba21081ed93/roles/caea830f617d461ca08b1b747e2500a1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:55.584634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978efff-212c-489d-806b-6522eafcf6db None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:55.639602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:55.655453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 193/397] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:55.671209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c699-ded1-457a-977e-e5bd1c3fba36 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:55.732660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978efff-212c-489d-806b-6522eafcf6db None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:55.802401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2414-cd5a-4e6a-91b5-91df3f813d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:55.803082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2414-cd5a-4e6a-91b5-91df3f813d17 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.803353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2414-cd5a-4e6a-91b5-91df3f813d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.803621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c2414-cd5a-4e6a-91b5-91df3f813d17 None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/groups/c00117d71b57479bb0a59ba21081ed93/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.807058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c2414-cd5a-4e6a-91b5-91df3f813d17 None admin] RBAC: Authorizing `identity:create_grant(project_id=3bd99e67c7d5401abc8f0c2d95e888a8, group_id=c00117d71b57479bb0a59ba21081ed93, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:55.807843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:55.808995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c2414-cd5a-4e6a-91b5-91df3f813d17 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:55.828656 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 205/398] 10.222.0.48 () {58 vars in 1442 bytes} [Sat Sep 17 03:23:55 2022] PUT /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8/groups/c00117d71b57479bb0a59ba21081ed93/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:55.861845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c699-ded1-457a-977e-e5bd1c3fba36 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:55.911641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde89f-6dd8-40da-a6b3-81fc507d53ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:55.912190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde89f-6dd8-40da-a6b3-81fc507d53ed None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:55.912468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde89f-6dd8-40da-a6b3-81fc507d53ed None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:55.912739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bde89f-6dd8-40da-a6b3-81fc507d53ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:55.927563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bde89f-6dd8-40da-a6b3-81fc507d53ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-94bde89f-6dd8-40da-a6b3-81fc507d53ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:55.932593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:55.933508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:55.934356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:55.938094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 194/399] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:55.939892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2414-cd5a-4e6a-91b5-91df3f813d17 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:55.973715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde89f-6dd8-40da-a6b3-81fc507d53ed None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:56.125390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c2414-cd5a-4e6a-91b5-91df3f813d17 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:56.144100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bde89f-6dd8-40da-a6b3-81fc507d53ed None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:56.144383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:56.167690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:56.168599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.169064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.169525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.170965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:56.171587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:56.173394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:56.177840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:56.185643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 206/400] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:56.190734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf33f2-bf81-4b8c-82ea-6cecbb632591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:56.191342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:56.192019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf33f2-bf81-4b8c-82ea-6cecbb632591 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.192435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf33f2-bf81-4b8c-82ea-6cecbb632591 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.192888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf33f2-bf81-4b8c-82ea-6cecbb632591 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.218789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf33f2-bf81-4b8c-82ea-6cecbb632591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1bcf33f2-bf81-4b8c-82ea-6cecbb632591 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:56.223975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:56.225022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:56.226051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:23:56.236809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 195/401] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:56.242777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf33f2-bf81-4b8c-82ea-6cecbb632591 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:56.334729 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd1c51-4973-4707-bec1-c42ad90264f5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:56.378936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c85167-6f8f-4968-b138-668d9109f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:56.379581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c85167-6f8f-4968-b138-668d9109f87f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.379851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c85167-6f8f-4968-b138-668d9109f87f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.380120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c85167-6f8f-4968-b138-668d9109f87f None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.382077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c85167-6f8f-4968-b138-668d9109f87f None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:56.383618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c85167-6f8f-4968-b138-668d9109f87f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:56.385399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 207/402] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:56 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:56.392184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c85167-6f8f-4968-b138-668d9109f87f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:56.436249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:56.447114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf33f2-bf81-4b8c-82ea-6cecbb632591 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:56.482865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dfb671-3527-4ca1-9188-c65796b0a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:56.483579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfb671-3527-4ca1-9188-c65796b0a452 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.483860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfb671-3527-4ca1-9188-c65796b0a452 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.484127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dfb671-3527-4ca1-9188-c65796b0a452 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.484919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfb671-3527-4ca1-9188-c65796b0a452 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:56.485200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfb671-3527-4ca1-9188-c65796b0a452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:56.486607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dfb671-3527-4ca1-9188-c65796b0a452 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:56.495371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 196/403] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:56.496818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213118bc-9e03-4905-931d-6aa115ec68d0 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.497110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213118bc-9e03-4905-931d-6aa115ec68d0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.497371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213118bc-9e03-4905-931d-6aa115ec68d0 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.499159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 197/404] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:56.501939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213118bc-9e03-4905-931d-6aa115ec68d0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:56.517980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c85167-6f8f-4968-b138-668d9109f87f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:56.559155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:56.560110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90264a-f31e-4375-8628-56baedef407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:56.560978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90264a-f31e-4375-8628-56baedef407c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.561393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90264a-f31e-4375-8628-56baedef407c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.561947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90264a-f31e-4375-8628-56baedef407c None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.564349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90264a-f31e-4375-8628-56baedef407c None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:56.566512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe90264a-f31e-4375-8628-56baedef407c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:56.568727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 208/405] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:56 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:56.570775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541be4a-179b-4e0d-85fc-954bb6cf52f4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.571218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541be4a-179b-4e0d-85fc-954bb6cf52f4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.571875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a541be4a-179b-4e0d-85fc-954bb6cf52f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.591728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a541be4a-179b-4e0d-85fc-954bb6cf52f4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:56.593272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a541be4a-179b-4e0d-85fc-954bb6cf52f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:56.616186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213118bc-9e03-4905-931d-6aa115ec68d0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:56.655207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27740840-ba76-490f-a45f-eb8d4f5727f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:56.656049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740840-ba76-490f-a45f-eb8d4f5727f9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.656419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740840-ba76-490f-a45f-eb8d4f5727f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.656784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27740840-ba76-490f-a45f-eb8d4f5727f9 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.658143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27740840-ba76-490f-a45f-eb8d4f5727f9 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:56.659845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27740840-ba76-490f-a45f-eb8d4f5727f9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:56.662191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 198/406] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:56 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:56.663074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27740840-ba76-490f-a45f-eb8d4f5727f9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:56.672527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 209/407] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:56.673810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541be4a-179b-4e0d-85fc-954bb6cf52f4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:56.704267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:56.791677 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27740840-ba76-490f-a45f-eb8d4f5727f9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:56.812385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:56.815667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a541be4a-179b-4e0d-85fc-954bb6cf52f4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:56.838578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ffd20-7814-4cea-9d7a-48ba234c2398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:56.839475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ffd20-7814-4cea-9d7a-48ba234c2398 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.839892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ffd20-7814-4cea-9d7a-48ba234c2398 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.840358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ffd20-7814-4cea-9d7a-48ba234c2398 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373/groups/c00117d71b57479bb0a59ba21081ed93/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.843412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ffd20-7814-4cea-9d7a-48ba234c2398 None admin] RBAC: Authorizing `identity:create_grant(project_id=eadce91e10de414c90dbb6670817c373, group_id=c00117d71b57479bb0a59ba21081ed93, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:56.846350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ffd20-7814-4cea-9d7a-48ba234c2398 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:56.870964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0090-3f15-4ef1-b155-feea50086239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:56.878059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 199/408] 10.222.0.48 () {58 vars in 1442 bytes} [Sat Sep 17 03:23:56 2022] PUT /identity/v3/projects/eadce91e10de414c90dbb6670817c373/groups/c00117d71b57479bb0a59ba21081ed93/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:56.878606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0090-3f15-4ef1-b155-feea50086239 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:56.879052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0090-3f15-4ef1-b155-feea50086239 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:56.879471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0090-3f15-4ef1-b155-feea50086239 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:56.880865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f0090-3f15-4ef1-b155-feea50086239 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:56.882514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f0090-3f15-4ef1-b155-feea50086239 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:56.884729 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 210/409] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:56 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:56.890865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ffd20-7814-4cea-9d7a-48ba234c2398 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:57.002383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0090-3f15-4ef1-b155-feea50086239 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:57.044653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ffd20-7814-4cea-9d7a-48ba234c2398 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:57.119314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8e8ad-88fc-4c9c-a985-165a2763c598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:57.120004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8e8ad-88fc-4c9c-a985-165a2763c598 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:57.120329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8e8ad-88fc-4c9c-a985-165a2763c598 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:57.120607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c8e8ad-88fc-4c9c-a985-165a2763c598 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373/groups/c00117d71b57479bb0a59ba21081ed93/roles/caea830f617d461ca08b1b747e2500a1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:57.123507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8e8ad-88fc-4c9c-a985-165a2763c598 None admin] RBAC: Authorizing `identity:create_grant(project_id=eadce91e10de414c90dbb6670817c373, group_id=c00117d71b57479bb0a59ba21081ed93, role_id=caea830f617d461ca08b1b747e2500a1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:57.125017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c8e8ad-88fc-4c9c-a985-165a2763c598 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:57.151975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 200/410] 10.222.0.48 () {58 vars in 1442 bytes} [Sat Sep 17 03:23:56 2022] PUT /identity/v3/projects/eadce91e10de414c90dbb6670817c373/groups/c00117d71b57479bb0a59ba21081ed93/roles/caea830f617d461ca08b1b747e2500a1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:57.157362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:57.166648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0090-3f15-4ef1-b155-feea50086239 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:57.223616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddb69c-8b0e-4f63-8258-7de3a518b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:57.224293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb69c-8b0e-4f63-8258-7de3a518b58c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:57.224569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb69c-8b0e-4f63-8258-7de3a518b58c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:57.224833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddb69c-8b0e-4f63-8258-7de3a518b58c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:57.238281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddb69c-8b0e-4f63-8258-7de3a518b58c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-12ddb69c-8b0e-4f63-8258-7de3a518b58c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:57.243284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:57.244248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:57.245059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 211/411] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:23:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:57.250614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8e8ad-88fc-4c9c-a985-165a2763c598 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:57.332363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:57.422454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c8e8ad-88fc-4c9c-a985-165a2763c598 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:57.461915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:57.463351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:57.463834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:57.464316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:57.465176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:57.465668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:57.467353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:57.481101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 201/412] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:57.482768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddb69c-8b0e-4f63-8258-7de3a518b58c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:57.595670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddb69c-8b0e-4f63-8258-7de3a518b58c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:57.630046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb398c2-4ab0-4792-a9e5-63a5dadaf588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:57.631222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb398c2-4ab0-4792-a9e5-63a5dadaf588 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:57.631728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb398c2-4ab0-4792-a9e5-63a5dadaf588 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:57.632189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb398c2-4ab0-4792-a9e5-63a5dadaf588 None admin] PATH_INFO: `/v3/groups/dd02a75ad55e4da4b42ad41dbbb2e6b5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:57.633532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb398c2-4ab0-4792-a9e5-63a5dadaf588 None admin] RBAC: Authorizing `identity:get_group(group_id=dd02a75ad55e4da4b42ad41dbbb2e6b5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:57.635221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb398c2-4ab0-4792-a9e5-63a5dadaf588 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:57.641818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 212/413] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:57 2022] GET /identity/v3/groups/dd02a75ad55e4da4b42ad41dbbb2e6b5 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:57.643561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:57.769457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:57.772605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79647b40-39cd-4bd4-b6c0-c0b9f9ba915e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:57.821355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd52163-2c8d-4a9a-961c-4748dda8a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:57.822019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52163-2c8d-4a9a-961c-4748dda8a149 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:57.822295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52163-2c8d-4a9a-961c-4748dda8a149 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:57.822563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd52163-2c8d-4a9a-961c-4748dda8a149 None admin] PATH_INFO: `/v3/projects/04f74c924c074ea694d34911dde51343` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:57.823686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd52163-2c8d-4a9a-961c-4748dda8a149 None admin] RBAC: Authorizing `identity:get_project(project_id=04f74c924c074ea694d34911dde51343)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:57.825134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd52163-2c8d-4a9a-961c-4748dda8a149 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:57.827090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 202/414] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:57 2022] GET /identity/v3/projects/04f74c924c074ea694d34911dde51343 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:57.832922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb398c2-4ab0-4792-a9e5-63a5dadaf588 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:57.868864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:57.969771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb398c2-4ab0-4792-a9e5-63a5dadaf588 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:58.018052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0062e590-58e5-44df-942b-a0c4ec1e591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:58.018718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062e590-58e5-44df-942b-a0c4ec1e591b None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:58.018994 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062e590-58e5-44df-942b-a0c4ec1e591b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:58.019265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0062e590-58e5-44df-942b-a0c4ec1e591b None admin] PATH_INFO: `/v3/projects/04f74c924c074ea694d34911dde51343/groups/dd02a75ad55e4da4b42ad41dbbb2e6b5/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:58.021264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062e590-58e5-44df-942b-a0c4ec1e591b None admin] RBAC: Authorizing `identity:create_grant(project_id=04f74c924c074ea694d34911dde51343, group_id=dd02a75ad55e4da4b42ad41dbbb2e6b5, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:58.022766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0062e590-58e5-44df-942b-a0c4ec1e591b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:58.047155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 213/415] 10.222.0.48 () {58 vars in 1442 bytes} [Sat Sep 17 03:23:57 2022] PUT /identity/v3/projects/04f74c924c074ea694d34911dde51343/groups/dd02a75ad55e4da4b42ad41dbbb2e6b5/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:23:58.341780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ba986-efdb-4de7-8cc6-68b53d4e7db7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:58.342526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ba986-efdb-4de7-8cc6-68b53d4e7db7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:58.343016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0ba986-efdb-4de7-8cc6-68b53d4e7db7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:58.344818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 203/416] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:58.350674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaba686-2034-483c-9936-b935ff7d8589 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:58.351218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaba686-2034-483c-9936-b935ff7d8589 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:58.351724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaba686-2034-483c-9936-b935ff7d8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:58.370535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-beaba686-2034-483c-9936-b935ff7d8589 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:58.371987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-beaba686-2034-483c-9936-b935ff7d8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:58.450868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae7f6-8920-42f6-a240-e6b91c5285dd None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:58.451196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae7f6-8920-42f6-a240-e6b91c5285dd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:58.451484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dae7f6-8920-42f6-a240-e6b91c5285dd None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:58.453023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 204/417] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:58.458095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808a08-3c35-4ab5-ad2f-c27949e24c0d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:58.458365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 214/418] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:58.458479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808a08-3c35-4ab5-ad2f-c27949e24c0d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:58.458718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b808a08-3c35-4ab5-ad2f-c27949e24c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:58.494758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9b808a08-3c35-4ab5-ad2f-c27949e24c0d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:23:58.495975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9b808a08-3c35-4ab5-ad2f-c27949e24c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:23:58.585163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 205/419] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:23:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:23:58.732758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaba686-2034-483c-9936-b935ff7d8589 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:58.747818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:58.838230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaba686-2034-483c-9936-b935ff7d8589 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:58.872358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644e7a4-1ee0-4aab-bf47-25c836662b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:58.872985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e7a4-1ee0-4aab-bf47-25c836662b5d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:58.873258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e7a4-1ee0-4aab-bf47-25c836662b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:58.873524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d644e7a4-1ee0-4aab-bf47-25c836662b5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:58.884123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d644e7a4-1ee0-4aab-bf47-25c836662b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d644e7a4-1ee0-4aab-bf47-25c836662b5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:58.889336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:58.890242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:58.891050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 215/420] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:23:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:23:58.897743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b808a08-3c35-4ab5-ad2f-c27949e24c0d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:58.963290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644e7a4-1ee0-4aab-bf47-25c836662b5d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:59.036065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:59.041168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b808a08-3c35-4ab5-ad2f-c27949e24c0d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:59.087683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:59.095418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:59.096367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:59.096842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:59.097328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:59.098288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:59.098817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:59.100572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:59.109701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 206/421] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:23:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:59.115922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:59.128137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d644e7a4-1ee0-4aab-bf47-25c836662b5d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:59.191490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532af0-0ee7-4038-8379-755fc9ba3384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:59.192144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532af0-0ee7-4038-8379-755fc9ba3384 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:59.192421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532af0-0ee7-4038-8379-755fc9ba3384 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:59.192693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8532af0-0ee7-4038-8379-755fc9ba3384 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:59.215937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8532af0-0ee7-4038-8379-755fc9ba3384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b8532af0-0ee7-4038-8379-755fc9ba3384 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:23:59.229266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:23:59.230314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:23:59.231210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 216/422] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:23:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:23:59.232862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f94dd-7204-44bd-ac21-077dd07ab599 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:59.237231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532af0-0ee7-4038-8379-755fc9ba3384 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:59.268577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0677f4-d7af-4b60-96f9-26aec000b0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:59.269529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0677f4-d7af-4b60-96f9-26aec000b0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:59.269989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0677f4-d7af-4b60-96f9-26aec000b0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:59.270446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0677f4-d7af-4b60-96f9-26aec000b0b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:59.298888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:59.339752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0677f4-d7af-4b60-96f9-26aec000b0b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:59.341451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0677f4-d7af-4b60-96f9-26aec000b0b3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:59.419272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8532af0-0ee7-4038-8379-755fc9ba3384 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:59.464949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:59.466372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 207/423] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 03:23:59.472659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0677f4-d7af-4b60-96f9-26aec000b0b3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:59.487937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:59.488580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:59.488853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:59.489314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:59.490170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] RBAC: Adding query filter params (name=member) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:23:59.490617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:59.492190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:59.513210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 217/424] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:23:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:59.519108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:59.534286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:59.609158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0677f4-d7af-4b60-96f9-26aec000b0b3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:59.675849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4cc57-49d2-4781-b6d3-94e7b328b40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:59.676851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4cc57-49d2-4781-b6d3-94e7b328b40c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:59.677122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4cc57-49d2-4781-b6d3-94e7b328b40c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:59.677386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4cc57-49d2-4781-b6d3-94e7b328b40c None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:59.679187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4cc57-49d2-4781-b6d3-94e7b328b40c None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:59.680908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f4cc57-49d2-4781-b6d3-94e7b328b40c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:59.682567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 208/425] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:23:59 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:23:59.691009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4cc57-49d2-4781-b6d3-94e7b328b40c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:23:59.730984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45005a-c965-4ac7-8bb2-2a325a2ac455 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:59.798902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38efb4-5b3c-463d-a9f7-2d6cd91de809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:59.799554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38efb4-5b3c-463d-a9f7-2d6cd91de809 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:59.799830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38efb4-5b3c-463d-a9f7-2d6cd91de809 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:59.800099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38efb4-5b3c-463d-a9f7-2d6cd91de809 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:59.856103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f4cc57-49d2-4781-b6d3-94e7b328b40c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:23:59.871839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:59.881027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38efb4-5b3c-463d-a9f7-2d6cd91de809 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:59.882863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a38efb4-5b3c-463d-a9f7-2d6cd91de809 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:59.887227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:23:59.896048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3c4a1-48a0-45ca-a356-3d07d2afd8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:23:59.896892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3c4a1-48a0-45ca-a356-3d07d2afd8ba None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:59.897417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3c4a1-48a0-45ca-a356-3d07d2afd8ba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:59.897926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3c4a1-48a0-45ca-a356-3d07d2afd8ba None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:59.900977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3c4a1-48a0-45ca-a356-3d07d2afd8ba None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:23:59.902621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e3c4a1-48a0-45ca-a356-3d07d2afd8ba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:23:59.909935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 209/426] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:23:59 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:23:59.911587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637765-673a-488e-a1cb-62da09e0baf6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:23:59.911951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637765-673a-488e-a1cb-62da09e0baf6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:23:59.912231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5637765-673a-488e-a1cb-62da09e0baf6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:23:59.913526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 210/427] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:23:59.914335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5637765-673a-488e-a1cb-62da09e0baf6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:00.019778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 218/428] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 03:24:00.021386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c323-6dc0-484e-9b00-f86db1cfd6e4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.021849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c323-6dc0-484e-9b00-f86db1cfd6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.022291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1c323-6dc0-484e-9b00-f86db1cfd6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.041061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-82a1c323-6dc0-484e-9b00-f86db1cfd6e4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:00.042592 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-82a1c323-6dc0-484e-9b00-f86db1cfd6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:00.045081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5637765-673a-488e-a1cb-62da09e0baf6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:00.081999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:00.082697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.083145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.083560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.084417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] RBAC: Adding query filter params (group.id=c00117d71b57479bb0a59ba21081ed93, role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:00.084858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:00.086615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:00.093241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 211/429] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:23:59 2022] GET /identity/v3/role_assignments?group.id=c00117d71b57479bb0a59ba21081ed93&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=caea830f617d461ca08b1b747e2500a1 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:00.099085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:00.125548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 219/430] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:00.126949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753657a-618a-44c5-8a83-ac86696d6b6d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.127346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753657a-618a-44c5-8a83-ac86696d6b6d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.127625 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753657a-618a-44c5-8a83-ac86696d6b6d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.129883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 220/431] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:00.137783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fb1c-4756-4d88-b3bd-21ca7e525308 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.138059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fb1c-4756-4d88-b3bd-21ca7e525308 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.138527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d7fb1c-4756-4d88-b3bd-21ca7e525308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.176396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-35d7fb1c-4756-4d88-b3bd-21ca7e525308 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:00.178142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-35d7fb1c-4756-4d88-b3bd-21ca7e525308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:00.187855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:00.237226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:00.295881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171f392-5d21-45ee-9c66-f7439b0295b6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:00.300461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 221/432] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:00.341863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8019-23a1-421a-9bf3-de04f513b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:00.342796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8019-23a1-421a-9bf3-de04f513b32b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.343208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8019-23a1-421a-9bf3-de04f513b32b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.343619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc8019-23a1-421a-9bf3-de04f513b32b None admin] PATH_INFO: `/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.344958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8019-23a1-421a-9bf3-de04f513b32b None admin] RBAC: Authorizing `identity:get_project(project_id=3bd99e67c7d5401abc8f0c2d95e888a8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:00.346657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc8019-23a1-421a-9bf3-de04f513b32b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:00.348460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 212/433] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:24:00 2022] GET /identity/v3/projects/3bd99e67c7d5401abc8f0c2d95e888a8 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:00.354140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7fb1c-4756-4d88-b3bd-21ca7e525308 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:00.461644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8019-23a1-421a-9bf3-de04f513b32b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:00.463104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d7fb1c-4756-4d88-b3bd-21ca7e525308 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:00.511508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eac208-83e9-494a-834e-dcfc466c0ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:00.512612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eac208-83e9-494a-834e-dcfc466c0ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.512906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eac208-83e9-494a-834e-dcfc466c0ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.513182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eac208-83e9-494a-834e-dcfc466c0ab4 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.514745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eac208-83e9-494a-834e-dcfc466c0ab4 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:00.516559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eac208-83e9-494a-834e-dcfc466c0ab4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:00.523421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 222/434] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:24:00 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:00.526405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a4f1-ce93-4351-9371-f7e2ed3954e2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.526695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a4f1-ce93-4351-9371-f7e2ed3954e2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.526945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a34a4f1-ce93-4351-9371-f7e2ed3954e2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.528344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 223/435] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:24:00.528901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34a4f1-ce93-4351-9371-f7e2ed3954e2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:00.560587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:00.609217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc8019-23a1-421a-9bf3-de04f513b32b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:00.635448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:00.644059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a34a4f1-ce93-4351-9371-f7e2ed3954e2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:00.644916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d594e1-616f-4811-9aeb-0af448dc92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:00.645556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d594e1-616f-4811-9aeb-0af448dc92a7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.645862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d594e1-616f-4811-9aeb-0af448dc92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.646168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d594e1-616f-4811-9aeb-0af448dc92a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.656509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d594e1-616f-4811-9aeb-0af448dc92a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c8d594e1-616f-4811-9aeb-0af448dc92a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:00.661849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:00.662861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:00.663702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 213/436] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:00.664531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629725-020b-457c-b5f1-b469fb5f1102 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.664818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629725-020b-457c-b5f1-b469fb5f1102 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.665091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce629725-020b-457c-b5f1-b469fb5f1102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.682937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:00.683250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ce629725-020b-457c-b5f1-b469fb5f1102 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:00.683540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.683815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.684079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.684458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ce629725-020b-457c-b5f1-b469fb5f1102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:00.684807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] RBAC: Adding query filter params (group.id=c00117d71b57479bb0a59ba21081ed93, role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:00.685132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:00.686621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:00.692260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 224/437] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:24:00 2022] GET /identity/v3/role_assignments?group.id=c00117d71b57479bb0a59ba21081ed93&scope.project.id=3bd99e67c7d5401abc8f0c2d95e888a8&role.id=d907003acd2748ac99d722b1aea4288a => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:00.693039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:00.755996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 214/438] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:00.757243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce629725-020b-457c-b5f1-b469fb5f1102 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:00.818145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:00.838442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb6fc61-998b-44a2-8ea3-669202819255 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:00.881684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fcb5b-b570-402a-8104-8c32b6eaf6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:00.882351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcb5b-b570-402a-8104-8c32b6eaf6ba None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.882690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcb5b-b570-402a-8104-8c32b6eaf6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.882962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fcb5b-b570-402a-8104-8c32b6eaf6ba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.884371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce629725-020b-457c-b5f1-b469fb5f1102 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:00.894524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fcb5b-b570-402a-8104-8c32b6eaf6ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ad6fcb5b-b570-402a-8104-8c32b6eaf6ba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:00.900031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:00.900965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:00.901790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 225/439] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:00.907092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fcb5b-b570-402a-8104-8c32b6eaf6ba None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:00.910133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:00.931741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:00.932696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:00.933201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:00.933532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:00.934298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:00.934594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:00.935982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:00.945905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 215/440] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:24:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:00.954855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.040079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fcb5b-b570-402a-8104-8c32b6eaf6ba None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.082241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4303-e545-42e2-95ed-199efb905c3a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.086373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.086988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.087265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.087533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.088205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:01.088512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:01.090089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:01.098655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 226/441] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:01.099852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.111600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.119858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9c68f-62cb-43a1-be8b-6aebdc3d310f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.120573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9c68f-62cb-43a1-be8b-6aebdc3d310f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.120856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9c68f-62cb-43a1-be8b-6aebdc3d310f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.121126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9c68f-62cb-43a1-be8b-6aebdc3d310f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.175717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.200056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9c68f-62cb-43a1-be8b-6aebdc3d310f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:01.201547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9c68f-62cb-43a1-be8b-6aebdc3d310f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:01.220663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3aef3-b64a-4f45-a148-fe845497d6b4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.261172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f98c33-cfb7-4bc9-bd6b-c041e5366129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.261913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f98c33-cfb7-4bc9-bd6b-c041e5366129 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.262197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f98c33-cfb7-4bc9-bd6b-c041e5366129 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.262475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f98c33-cfb7-4bc9-bd6b-c041e5366129 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.273680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f98c33-cfb7-4bc9-bd6b-c041e5366129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a7f98c33-cfb7-4bc9-bd6b-c041e5366129 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:01.279137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:01.280151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:01.280962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 227/442] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:01.282590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f98c33-cfb7-4bc9-bd6b-c041e5366129 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.314996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 216/443] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:01.319593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9c68f-62cb-43a1-be8b-6aebdc3d310f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.350638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.390376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f98c33-cfb7-4bc9-bd6b-c041e5366129 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.402041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.420914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9c68f-62cb-43a1-be8b-6aebdc3d310f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.422225 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b485ea-1325-478f-a100-3c1f2928974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.422830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b485ea-1325-478f-a100-3c1f2928974a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.423120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b485ea-1325-478f-a100-3c1f2928974a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.423385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b485ea-1325-478f-a100-3c1f2928974a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.454160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.454762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.455041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.455292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.455951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:01.456251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:01.457635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:01.465620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 217/444] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:01.466508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.488718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b485ea-1325-478f-a100-3c1f2928974a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:01.490235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b485ea-1325-478f-a100-3c1f2928974a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:01.553387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.566776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0e3fd-028a-42fb-be23-6bf89d2ff027 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.588156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 228/445] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:01.589010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b485ea-1325-478f-a100-3c1f2928974a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.600419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449d7c9-71f4-4fef-a0f4-e9defa668303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.601051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d7c9-71f4-4fef-a0f4-e9defa668303 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.601386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d7c9-71f4-4fef-a0f4-e9defa668303 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.601654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449d7c9-71f4-4fef-a0f4-e9defa668303 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.602790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449d7c9-71f4-4fef-a0f4-e9defa668303 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:01.604235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449d7c9-71f4-4fef-a0f4-e9defa668303 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:01.605860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 218/446] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:01.606610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449d7c9-71f4-4fef-a0f4-e9defa668303 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.619875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.700616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b485ea-1325-478f-a100-3c1f2928974a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.714107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449d7c9-71f4-4fef-a0f4-e9defa668303 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.734859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dd885-b0a1-4b55-b4ad-330ab9f928b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.735481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dd885-b0a1-4b55-b4ad-330ab9f928b5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.735752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dd885-b0a1-4b55-b4ad-330ab9f928b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.736014 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dd885-b0a1-4b55-b4ad-330ab9f928b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.747244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05aab0-f9a7-4e08-83f4-9c4539166ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.747877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05aab0-f9a7-4e08-83f4-9c4539166ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.748157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05aab0-f9a7-4e08-83f4-9c4539166ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.748520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05aab0-f9a7-4e08-83f4-9c4539166ce4 None admin] PATH_INFO: `/v3/projects/eadce91e10de414c90dbb6670817c373` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.749631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05aab0-f9a7-4e08-83f4-9c4539166ce4 None admin] RBAC: Authorizing `identity:get_project(project_id=eadce91e10de414c90dbb6670817c373)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:01.751127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05aab0-f9a7-4e08-83f4-9c4539166ce4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:01.752740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 219/447] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/projects/eadce91e10de414c90dbb6670817c373 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:01.753501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05aab0-f9a7-4e08-83f4-9c4539166ce4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.774219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.809146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dd885-b0a1-4b55-b4ad-330ab9f928b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:01.810650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dd885-b0a1-4b55-b4ad-330ab9f928b5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:01.831815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.853545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05aab0-f9a7-4e08-83f4-9c4539166ce4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:01.885637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0892b-7871-4fc8-9afd-d5ec324f1203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:01.886286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0892b-7871-4fc8-9afd-d5ec324f1203 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:01.886546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0892b-7871-4fc8-9afd-d5ec324f1203 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:01.886812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0892b-7871-4fc8-9afd-d5ec324f1203 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:01.887926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0892b-7871-4fc8-9afd-d5ec324f1203 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:01.889707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa0892b-7871-4fc8-9afd-d5ec324f1203 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:01.891485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 220/448] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:01.892048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0892b-7871-4fc8-9afd-d5ec324f1203 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.916912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 229/449] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:01.916912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dd885-b0a1-4b55-b4ad-330ab9f928b5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:01.976866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:01.995143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa0892b-7871-4fc8-9afd-d5ec324f1203 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:02.014884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dd885-b0a1-4b55-b4ad-330ab9f928b5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:02.030242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7553820-f5e0-4537-908c-ccb28c377612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:02.030878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553820-f5e0-4537-908c-ccb28c377612 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:02.031153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553820-f5e0-4537-908c-ccb28c377612 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:02.031419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7553820-f5e0-4537-908c-ccb28c377612 None admin] PATH_INFO: `/v3/groups/c00117d71b57479bb0a59ba21081ed93` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:02.032535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7553820-f5e0-4537-908c-ccb28c377612 None admin] RBAC: Authorizing `identity:get_group(group_id=c00117d71b57479bb0a59ba21081ed93)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:02.034001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7553820-f5e0-4537-908c-ccb28c377612 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:02.035566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 221/450] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/groups/c00117d71b57479bb0a59ba21081ed93 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:02.036306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7553820-f5e0-4537-908c-ccb28c377612 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:02.050134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:02.050744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:02.051022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:02.051292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:02.051961 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:02.052083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] RBAC: Adding query filter params (group.id=c00117d71b57479bb0a59ba21081ed93, role.id=d907003acd2748ac99d722b1aea4288a, scope.project.id=eadce91e10de414c90dbb6670817c373) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:02.052316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:02.053740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:02.059617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 230/451] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:24:01 2022] GET /identity/v3/role_assignments?group.id=c00117d71b57479bb0a59ba21081ed93&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=d907003acd2748ac99d722b1aea4288a => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:02.060394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:02.158745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7553820-f5e0-4537-908c-ccb28c377612 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:02.171998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cad83a-e2b7-4d59-9bd6-9419dbd91057 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:02.196186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f672803-8e8e-48fe-baa8-4711ece538e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:02.196839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672803-8e8e-48fe-baa8-4711ece538e4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:02.197114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672803-8e8e-48fe-baa8-4711ece538e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:02.197383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f672803-8e8e-48fe-baa8-4711ece538e4 None admin] PATH_INFO: `/v3/projects/04f74c924c074ea694d34911dde51343` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:02.198564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f672803-8e8e-48fe-baa8-4711ece538e4 None admin] RBAC: Authorizing `identity:get_project(project_id=04f74c924c074ea694d34911dde51343)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:02.200027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f672803-8e8e-48fe-baa8-4711ece538e4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:02.201691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 222/452] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:24:02 2022] GET /identity/v3/projects/04f74c924c074ea694d34911dde51343 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:02.207590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f672803-8e8e-48fe-baa8-4711ece538e4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:02.209553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:02.216246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:02.216868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:02.217146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:02.217416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:02.218802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] RBAC: Adding query filter params (group.id=c00117d71b57479bb0a59ba21081ed93, role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=eadce91e10de414c90dbb6670817c373) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:02.219112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:02.220998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:02.228875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 231/453] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:24:02 2022] GET /identity/v3/role_assignments?group.id=c00117d71b57479bb0a59ba21081ed93&scope.project.id=eadce91e10de414c90dbb6670817c373&role.id=caea830f617d461ca08b1b747e2500a1 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:02.306199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:02.328282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f672803-8e8e-48fe-baa8-4711ece538e4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:02.366931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71b3cd-7369-4c09-b7d5-ec0d760808d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:02.367593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71b3cd-7369-4c09-b7d5-ec0d760808d3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:02.367867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71b3cd-7369-4c09-b7d5-ec0d760808d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:02.368135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71b3cd-7369-4c09-b7d5-ec0d760808d3 None admin] PATH_INFO: `/v3/groups/dd02a75ad55e4da4b42ad41dbbb2e6b5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:02.369310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71b3cd-7369-4c09-b7d5-ec0d760808d3 None admin] RBAC: Authorizing `identity:get_group(group_id=dd02a75ad55e4da4b42ad41dbbb2e6b5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:02.370794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71b3cd-7369-4c09-b7d5-ec0d760808d3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:02.372406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 223/454] 10.222.0.48 () {56 vars in 1180 bytes} [Sat Sep 17 03:24:02 2022] GET /identity/v3/groups/dd02a75ad55e4da4b42ad41dbbb2e6b5 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:02.379039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:02.492639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d554d40-c0f1-4de3-be35-d60a56571bf1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:02.526097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0fdb8-b9ed-4ebb-8231-5cdd3902e75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:02.526699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fdb8-b9ed-4ebb-8231-5cdd3902e75a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:02.526976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fdb8-b9ed-4ebb-8231-5cdd3902e75a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:02.527248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0fdb8-b9ed-4ebb-8231-5cdd3902e75a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:02.527983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0fdb8-b9ed-4ebb-8231-5cdd3902e75a None admin] RBAC: Adding query filter params (group.id=dd02a75ad55e4da4b42ad41dbbb2e6b5, role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=04f74c924c074ea694d34911dde51343) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:02.528294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0fdb8-b9ed-4ebb-8231-5cdd3902e75a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:02.529742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0fdb8-b9ed-4ebb-8231-5cdd3902e75a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:02.535671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 232/455] 10.222.0.48 () {56 vars in 1376 bytes} [Sat Sep 17 03:24:02 2022] GET /identity/v3/role_assignments?group.id=dd02a75ad55e4da4b42ad41dbbb2e6b5&scope.project.id=04f74c924c074ea694d34911dde51343&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:05.187897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfe50-0192-4676-9cfa-2d158c40be5e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.188442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfe50-0192-4676-9cfa-2d158c40be5e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.188442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bbfe50-0192-4676-9cfa-2d158c40be5e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:05.190125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 224/456] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:05.195481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2559c-2b4a-45c1-9a3d-edf08c94f319 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.196280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2559c-2b4a-45c1-9a3d-edf08c94f319 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.196739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2559c-2b4a-45c1-9a3d-edf08c94f319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:05.226796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6ea2559c-2b4a-45c1-9a3d-edf08c94f319 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:05.228306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6ea2559c-2b4a-45c1-9a3d-edf08c94f319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:05.300319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:05.320086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 233/457] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:05.636487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbfe50-0192-4676-9cfa-2d158c40be5e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:05.742718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190664e4-a484-4f6f-966e-8a8f0100c19a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.743389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190664e4-a484-4f6f-966e-8a8f0100c19a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.743872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190664e4-a484-4f6f-966e-8a8f0100c19a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:05.745633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 234/458] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:05.751125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082532b8-c84a-4afa-89fb-def0f06b542b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.751643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082532b8-c84a-4afa-89fb-def0f06b542b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.752113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082532b8-c84a-4afa-89fb-def0f06b542b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:05.776193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bbfe50-0192-4676-9cfa-2d158c40be5e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:05.784843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-082532b8-c84a-4afa-89fb-def0f06b542b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:05.786061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-082532b8-c84a-4afa-89fb-def0f06b542b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:05.810574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82330a29-99a2-4738-9e8c-a30d1c5b64c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:05.811212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330a29-99a2-4738-9e8c-a30d1c5b64c1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.811497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330a29-99a2-4738-9e8c-a30d1c5b64c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.811760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82330a29-99a2-4738-9e8c-a30d1c5b64c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:05.821669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82330a29-99a2-4738-9e8c-a30d1c5b64c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:05.823173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82330a29-99a2-4738-9e8c-a30d1c5b64c1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-82330a29-99a2-4738-9e8c-a30d1c5b64c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:05.837984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:05.838908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:05.839765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:05.839765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:05.839765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:05.839765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 225/459] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:05.840723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933762f9-3fd2-4fdb-9314-402bbfb4794b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.841005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933762f9-3fd2-4fdb-9314-402bbfb4794b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.841272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933762f9-3fd2-4fdb-9314-402bbfb4794b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:05.847010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 226/460] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:05.847010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cdf3a-1319-4104-81dc-e836130075c8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.847010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cdf3a-1319-4104-81dc-e836130075c8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.847010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cdf3a-1319-4104-81dc-e836130075c8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:05.847010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 227/461] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:05.847010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cdf3a-1319-4104-81dc-e836130075c8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:05.849132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:05.866888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 235/462] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:05.871141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca1ce-56a1-43aa-bf1f-619992787a9d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.871479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca1ce-56a1-43aa-bf1f-619992787a9d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.871812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca1ce-56a1-43aa-bf1f-619992787a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:05.893677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-640ca1ce-56a1-43aa-bf1f-619992787a9d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:05.895001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-640ca1ce-56a1-43aa-bf1f-619992787a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:05.964242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cdf3a-1319-4104-81dc-e836130075c8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:05.982614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 236/463] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:05.984427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789180ef-75db-491b-9c61-b74dd1f715b6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:05.984730 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789180ef-75db-491b-9c61-b74dd1f715b6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:05.987658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789180ef-75db-491b-9c61-b74dd1f715b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.023196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-789180ef-75db-491b-9c61-b74dd1f715b6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:06.025404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-789180ef-75db-491b-9c61-b74dd1f715b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:06.042488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:06.043494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.043967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.044427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.045290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:06.045835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:06.047468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:06.066725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 228/464] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:06.074675 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:06.079072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:06.101427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 237/465] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:06.178031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789180ef-75db-491b-9c61-b74dd1f715b6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:06.182658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:06.257485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5ebc-af4d-48b4-bf81-96af9402b7b2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:06.309560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789180ef-75db-491b-9c61-b74dd1f715b6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:06.329512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84b78-4f1e-4bb5-a416-5e46bc6338bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:06.330175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84b78-4f1e-4bb5-a416-5e46bc6338bc None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.330454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84b78-4f1e-4bb5-a416-5e46bc6338bc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.330727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e84b78-4f1e-4bb5-a416-5e46bc6338bc None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.331383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e84b78-4f1e-4bb5-a416-5e46bc6338bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:06.332836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e84b78-4f1e-4bb5-a416-5e46bc6338bc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:06.345569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7150b37-110c-4392-8991-51e4f797e6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:06.346296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150b37-110c-4392-8991-51e4f797e6ee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.346749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150b37-110c-4392-8991-51e4f797e6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.347796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7150b37-110c-4392-8991-51e4f797e6ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.360003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7150b37-110c-4392-8991-51e4f797e6ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:06.360539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 229/466] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:24:06 2022] POST /identity/v3/users => generated 246 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:06.365796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84b78-4f1e-4bb5-a416-5e46bc6338bc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:06.365952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7150b37-110c-4392-8991-51e4f797e6ee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f7150b37-110c-4392-8991-51e4f797e6ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:06.392385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:06.393576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:06.394587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:06.394587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:06.394587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:06.396295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 238/467] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:06.397710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1fa5b-3a54-4221-906f-798af6b0b97a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.398197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1fa5b-3a54-4221-906f-798af6b0b97a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.398596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1fa5b-3a54-4221-906f-798af6b0b97a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.400160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 239/468] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:06.403690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1fa5b-3a54-4221-906f-798af6b0b97a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:06.440657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:06.493680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e84b78-4f1e-4bb5-a416-5e46bc6338bc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:06.511849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:06.528383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1fa5b-3a54-4221-906f-798af6b0b97a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:06.533854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821bfc9-209b-406b-a332-03464fffe9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:06.534767 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821bfc9-209b-406b-a332-03464fffe9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.535189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821bfc9-209b-406b-a332-03464fffe9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.535590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821bfc9-209b-406b-a332-03464fffe9e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.548700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821bfc9-209b-406b-a332-03464fffe9e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:06.551298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821bfc9-209b-406b-a332-03464fffe9e4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:06.564698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:06.565348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.565626 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.565938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.566650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:06.566965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:06.568366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2821bfc9-209b-406b-a332-03464fffe9e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:06.568742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:06.569603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:06.570689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:06.570689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:06.570689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:06.570689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 230/469] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:06.571322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6a0c-337b-46c7-8644-82ffbae67582 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.571498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6a0c-337b-46c7-8644-82ffbae67582 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.571789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda6a0c-337b-46c7-8644-82ffbae67582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.584213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 240/470] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:06.585224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:06.591787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-adda6a0c-337b-46c7-8644-82ffbae67582 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:06.592992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-adda6a0c-337b-46c7-8644-82ffbae67582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:06.665383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 231/471] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:06.666388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda6a0c-337b-46c7-8644-82ffbae67582 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:06.692890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:06.705657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c7d827-445c-4397-91e9-b03f34466ea9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:06.754524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:06.755184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.755459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.755723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.767149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:06.768694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:06.777379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:06.784002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda6a0c-337b-46c7-8644-82ffbae67582 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:06.784692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:06.785853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:06.786963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:06.786963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:06.786963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:06.793058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 241/472] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:06.794038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:06.832316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:06.833188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.833610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.834073 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.834873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:06.835332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:06.836896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:06.853122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 232/473] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:06.854175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:06.906798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771838de-2bb9-4588-99ce-a376037da048 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:06.948124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b59065-813b-47a6-bdd6-67cb445e5181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:06.948715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59065-813b-47a6-bdd6-67cb445e5181 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:06.948988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59065-813b-47a6-bdd6-67cb445e5181 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:06.949258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b59065-813b-47a6-bdd6-67cb445e5181 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:06.949948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b59065-813b-47a6-bdd6-67cb445e5181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:06.951385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b59065-813b-47a6-bdd6-67cb445e5181 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:06.970570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:06.975381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07d550-f16e-4761-89fe-df36b57d20f9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:06.976691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 242/474] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:24:06 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:06.976691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b59065-813b-47a6-bdd6-67cb445e5181 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:07.037265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:07.038253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:07.038487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:07.038947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:07.039762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:07.040161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:07.041746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:07.055259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 233/475] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:07.060957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:07.087234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:07.120867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b59065-813b-47a6-bdd6-67cb445e5181 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:07.166097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905f6e6-4878-4fd9-8d15-22b09eafb0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:07.166829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905f6e6-4878-4fd9-8d15-22b09eafb0aa None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:07.167110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905f6e6-4878-4fd9-8d15-22b09eafb0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:07.167387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f905f6e6-4878-4fd9-8d15-22b09eafb0aa None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:07.168048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905f6e6-4878-4fd9-8d15-22b09eafb0aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:07.169521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f905f6e6-4878-4fd9-8d15-22b09eafb0aa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:07.182306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b42003e-4f24-4531-a975-81e61d43c875 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:07.205949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 243/476] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:24:06 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:07.206872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905f6e6-4878-4fd9-8d15-22b09eafb0aa None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:07.235231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:07.235875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:07.236283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:07.236630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:07.237374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:07.238901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:07.249966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.sql.core [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 03:24:07.249966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 17 03:24:07.249966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [parameters: {'id': 'cca3ead246974dd5ab1d738fa6f2f7d3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 17 03:24:07.249966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Sep 17 03:24:07.269032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return ref.to_dict() Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 03:24:07.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application yield resource Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise self.value Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application session.commit() Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 03:24:07.271721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.flush() Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application compat.raise_( Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 03:24:07.272643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 03:24:07.273616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 03:24:07.274511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [parameters: {'id': 'cca3ead246974dd5ab1d738fa6f2f7d3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:07.275400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 17 03:24:07.276218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:07.280062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 234/477] 10.222.0.48 () {60 vars in 1131 bytes} [Sat Sep 17 03:24:07 2022] POST /identity/v3/roles => generated 144 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:07.286850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:07.294375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:07.368484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f905f6e6-4878-4fd9-8d15-22b09eafb0aa None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:07.428076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:07.445380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f1350-1e8b-4ef9-b806-e7c80133fcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:07.445380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1350-1e8b-4ef9-b806-e7c80133fcef None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:07.445380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1350-1e8b-4ef9-b806-e7c80133fcef None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:07.445380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f1350-1e8b-4ef9-b806-e7c80133fcef None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:07.446123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f1350-1e8b-4ef9-b806-e7c80133fcef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:07.447762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f1350-1e8b-4ef9-b806-e7c80133fcef None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:07.457890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4493517-be55-433b-a201-1a563cce46d2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:07.481678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 244/478] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:24:07 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:07.514921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50684a22-ca4f-4978-95b6-5255ec5f32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:07.515595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50684a22-ca4f-4978-95b6-5255ec5f32b1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:07.515869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50684a22-ca4f-4978-95b6-5255ec5f32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:07.516139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50684a22-ca4f-4978-95b6-5255ec5f32b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:07.529327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50684a22-ca4f-4978-95b6-5255ec5f32b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-50684a22-ca4f-4978-95b6-5255ec5f32b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:07.534543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:07.535478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:07.536285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 235/479] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:07.546992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f1350-1e8b-4ef9-b806-e7c80133fcef None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:07.687938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f1350-1e8b-4ef9-b806-e7c80133fcef None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:07.701326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:07.724021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7d8509-b870-4de8-ac80-5dea3f4f35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:07.724564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8509-b870-4de8-ac80-5dea3f4f35be None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:07.724847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8509-b870-4de8-ac80-5dea3f4f35be None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:07.725115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7d8509-b870-4de8-ac80-5dea3f4f35be None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:07.725816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d8509-b870-4de8-ac80-5dea3f4f35be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:07.726120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d8509-b870-4de8-ac80-5dea3f4f35be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:07.727678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7d8509-b870-4de8-ac80-5dea3f4f35be None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:07.737223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 245/480] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:08.806182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef565d-a728-4581-aa4e-631895f05f8e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:08.807409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef565d-a728-4581-aa4e-631895f05f8e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:08.807899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef565d-a728-4581-aa4e-631895f05f8e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:08.809499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 236/481] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:08.815749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d5f37-4ae1-4930-9576-524757337ec2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:08.816754 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d5f37-4ae1-4930-9576-524757337ec2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:08.817288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d5f37-4ae1-4930-9576-524757337ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:08.844929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f66d5f37-4ae1-4930-9576-524757337ec2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:08.846558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f66d5f37-4ae1-4930-9576-524757337ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:08.941213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 246/482] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:09.337105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef565d-a728-4581-aa4e-631895f05f8e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:09.457225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef565d-a728-4581-aa4e-631895f05f8e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:09.500708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843cee61-72b0-4aef-bdba-654c9db3762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:09.501705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cee61-72b0-4aef-bdba-654c9db3762c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:09.502205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cee61-72b0-4aef-bdba-654c9db3762c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:09.502670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843cee61-72b0-4aef-bdba-654c9db3762c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:09.523177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843cee61-72b0-4aef-bdba-654c9db3762c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-843cee61-72b0-4aef-bdba-654c9db3762c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:09.533477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:09.534513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:09.535338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:09.538092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 237/483] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:09.544710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d5f37-4ae1-4930-9576-524757337ec2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:09.673514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d5f37-4ae1-4930-9576-524757337ec2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:09.675621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b822b02-0037-4667-8c75-0bf5abbaf756 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:09.676120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b822b02-0037-4667-8c75-0bf5abbaf756 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:09.676639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b822b02-0037-4667-8c75-0bf5abbaf756 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:09.678802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 238/484] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:24:09.682287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:09.685503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583446-9e90-4976-b1cd-0c9165312c16 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:09.686108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583446-9e90-4976-b1cd-0c9165312c16 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:09.686570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df583446-9e90-4976-b1cd-0c9165312c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:09.697389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:09.711089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-df583446-9e90-4976-b1cd-0c9165312c16 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:09.712450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-df583446-9e90-4976-b1cd-0c9165312c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:09.748772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:09.749538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:09.749939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:09.750875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:09.751655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:09.752241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:09.754302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:09.773239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 247/485] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:09.783172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:09.817050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 239/486] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:09.934799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826706be-d551-47d1-beb8-a1d7d07fdfbe None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:09.983803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0478ea-2587-4dd6-af17-9772fa85236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:09.984447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0478ea-2587-4dd6-af17-9772fa85236e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:09.985148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0478ea-2587-4dd6-af17-9772fa85236e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:09.985148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0478ea-2587-4dd6-af17-9772fa85236e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.005369 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0478ea-2587-4dd6-af17-9772fa85236e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:10.006853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0478ea-2587-4dd6-af17-9772fa85236e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6b0478ea-2587-4dd6-af17-9772fa85236e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:10.031928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:10.032905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:10.034445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:10.034445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:10.034445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:10.034445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 248/487] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:10.038841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df583446-9e90-4976-b1cd-0c9165312c16 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.042100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3621d00-1671-44c4-8982-da55958b0e7b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.042386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3621d00-1671-44c4-8982-da55958b0e7b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.042663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3621d00-1671-44c4-8982-da55958b0e7b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.043980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 249/488] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:10.048976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de672-8698-4ce4-8b66-dc7bfa525a7b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.049263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de672-8698-4ce4-8b66-dc7bfa525a7b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.049538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1de672-8698-4ce4-8b66-dc7bfa525a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.072841 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2d1de672-8698-4ce4-8b66-dc7bfa525a7b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:10.074073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2d1de672-8698-4ce4-8b66-dc7bfa525a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:10.100957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:10.180421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 250/489] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:24:10.181491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1de672-8698-4ce4-8b66-dc7bfa525a7b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.214316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df583446-9e90-4976-b1cd-0c9165312c16 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:10.281673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e333f-341d-4f2c-92f6-5f261765a329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:10.282318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e333f-341d-4f2c-92f6-5f261765a329 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.282593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e333f-341d-4f2c-92f6-5f261765a329 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.282861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e333f-341d-4f2c-92f6-5f261765a329 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.283508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e333f-341d-4f2c-92f6-5f261765a329 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:10.283807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e333f-341d-4f2c-92f6-5f261765a329 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:10.285206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e333f-341d-4f2c-92f6-5f261765a329 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:10.286916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:10.303916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 240/490] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:10.305422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a83a-5398-453a-a44f-bc4eeafa4bbe None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.305704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a83a-5398-453a-a44f-bc4eeafa4bbe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.305998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518a83a-5398-453a-a44f-bc4eeafa4bbe None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.311703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 241/491] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:10.312821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16b373-2946-4eca-b826-b8310e56a869 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.313094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16b373-2946-4eca-b826-b8310e56a869 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.313359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16b373-2946-4eca-b826-b8310e56a869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.330996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1f16b373-2946-4eca-b826-b8310e56a869 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:10.332153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1f16b373-2946-4eca-b826-b8310e56a869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:10.341786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1de672-8698-4ce4-8b66-dc7bfa525a7b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:10.379606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efcc35-4387-43cf-b00a-faf6e9bb1eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:10.380248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efcc35-4387-43cf-b00a-faf6e9bb1eda None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.380523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efcc35-4387-43cf-b00a-faf6e9bb1eda None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.380792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7efcc35-4387-43cf-b00a-faf6e9bb1eda None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.395766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7efcc35-4387-43cf-b00a-faf6e9bb1eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b7efcc35-4387-43cf-b00a-faf6e9bb1eda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:10.400774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:10.401669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:10.402529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:10.405840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 251/492] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:10.406866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efcc35-4387-43cf-b00a-faf6e9bb1eda None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.418834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 242/493] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:10.420001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16b373-2946-4eca-b826-b8310e56a869 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.420777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:10.519041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7efcc35-4387-43cf-b00a-faf6e9bb1eda None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:10.532826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16b373-2946-4eca-b826-b8310e56a869 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:10.559112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:10.560376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.560647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.560922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.563586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:10.572510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:10.574159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:10.583859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:10.584523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.584806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.585076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.585916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:10.586280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:10.587761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:10.591096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:10.591996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:10.592912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 252/494] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:10.593507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.603724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 243/495] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:10.604595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.681810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:10.716748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998d282-bf02-4507-b0ef-f81eec5257f0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:10.722613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd7df6-fb8e-4f36-9d85-dd4c0405e931 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:10.749010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0478c3-22b9-4613-af11-2700300f62fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:10.749636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0478c3-22b9-4613-af11-2700300f62fb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.749987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0478c3-22b9-4613-af11-2700300f62fb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.750248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0478c3-22b9-4613-af11-2700300f62fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.756381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:10.756981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.757251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.757546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.758310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:10.758606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:10.760067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:10.760416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0478c3-22b9-4613-af11-2700300f62fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-cb0478c3-22b9-4613-af11-2700300f62fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:10.766043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:10.766947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:10.767756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 253/496] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:10.768868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0478c3-22b9-4613-af11-2700300f62fb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.796413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 244/497] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:10.797167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.843522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:10.871819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0478c3-22b9-4613-af11-2700300f62fb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:10.895995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d2a2e-5c0f-459b-a9e1-675d24b09462 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:10.897838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:10.907930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660456c0-40ff-4658-bccc-54258475deeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:10.908567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660456c0-40ff-4658-bccc-54258475deeb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.908834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660456c0-40ff-4658-bccc-54258475deeb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.909100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660456c0-40ff-4658-bccc-54258475deeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.919411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660456c0-40ff-4658-bccc-54258475deeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:10.920861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660456c0-40ff-4658-bccc-54258475deeb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:10.929007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e4d5a-f522-4244-afd7-1d567fed9cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:10.929692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4d5a-f522-4244-afd7-1d567fed9cdb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.929996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4d5a-f522-4244-afd7-1d567fed9cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.930262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e4d5a-f522-4244-afd7-1d567fed9cdb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-660456c0-40ff-4658-bccc-54258475deeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:10.934407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:10.935768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:10.936658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:10.936658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:10.936658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:10.936658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 254/498] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:10.936936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c370-d5db-48cf-a56c-39c516b5f0b6 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:10.937211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c370-d5db-48cf-a56c-39c516b5f0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:10.937477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c370-d5db-48cf-a56c-39c516b5f0b6 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:10.938682 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 255/499] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:10.939363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74c370-d5db-48cf-a56c-39c516b5f0b6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:10.946788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e4d5a-f522-4244-afd7-1d567fed9cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9f0e4d5a-f522-4244-afd7-1d567fed9cdb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:10.951599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:10.952719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 245/500] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:10.953525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e4d5a-f522-4244-afd7-1d567fed9cdb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.047176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74c370-d5db-48cf-a56c-39c516b5f0b6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.058818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e4d5a-f522-4244-afd7-1d567fed9cdb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.061571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.080080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.080707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.080980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.081251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.081948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:11.082254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.083655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.091832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 256/501] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:11.092617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.098395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ebe29-8604-49e5-851a-109b9239acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.099012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ebe29-8604-49e5-851a-109b9239acc0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.099288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ebe29-8604-49e5-851a-109b9239acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.099555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ebe29-8604-49e5-851a-109b9239acc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.134542 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.167411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ebe29-8604-49e5-851a-109b9239acc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.168981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024ebe29-8604-49e5-851a-109b9239acc0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.190843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b70b2-aadf-4b90-b9c8-e36b058b8890 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.223103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b29658-a96b-4229-9834-fec56afb642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.223709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29658-a96b-4229-9834-fec56afb642a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.224017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29658-a96b-4229-9834-fec56afb642a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.224286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b29658-a96b-4229-9834-fec56afb642a None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.224923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b29658-a96b-4229-9834-fec56afb642a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:11.225222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b29658-a96b-4229-9834-fec56afb642a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.226691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b29658-a96b-4229-9834-fec56afb642a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.238293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 257/502] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:11.239452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b84eda-b420-4f64-89d4-ff80d62bcb43 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.239734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b84eda-b420-4f64-89d4-ff80d62bcb43 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.240003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b84eda-b420-4f64-89d4-ff80d62bcb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.257831 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-58b84eda-b420-4f64-89d4-ff80d62bcb43 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:11.259025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-58b84eda-b420-4f64-89d4-ff80d62bcb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:11.266988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 246/503] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:11.268059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ebe29-8604-49e5-851a-109b9239acc0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.272612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.329175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 258/504] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:11.329985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b84eda-b420-4f64-89d4-ff80d62bcb43 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.359966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.370430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024ebe29-8604-49e5-851a-109b9239acc0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.407578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.408184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.408457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.408722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.409375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:11.409670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.411082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.420124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 247/505] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:11.420923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.438644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b84eda-b420-4f64-89d4-ff80d62bcb43 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.476075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.476769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.477042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.477308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.488079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.489863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.490985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:11.506722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:11.507713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:11.508571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:11.508571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:11.508571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:11.508571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 259/506] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:11.514594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.530469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ee756-e356-4309-b4e2-c093a67145b7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.563932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.564562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.564843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.565118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.573520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.575039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:11.587439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:11.588357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 248/507] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:11.589256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.599052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.615727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e0d70-5ddd-467e-ac5f-9521bc17c866 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.649047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.649657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.649958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.650226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.660600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.662089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:11.676415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:11.677350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:11.678249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:11.678249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:11.678249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:11.678249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 260/508] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:11.678489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.691532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036c4b3-9f04-45e2-bc1a-9d2e80fdfa40 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.716397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.725442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.726132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.726410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.726680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.736763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.738272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:11.751899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:11.752950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:11.753833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:11.753833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:11.753833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:11.753833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 249/509] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:11.753833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.781632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f3f95-b2b8-4dd2-8bbf-d2b70a5f334a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.815630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.816226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.816489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.816756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.817390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:11.817684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.819090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.821428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.831571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 261/510] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:11.832383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.854515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f18982-1e5f-47c6-bc63-4a4246263a13 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.886859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.887469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.887740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.888005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.898513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.899986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:11.914037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:11.914943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:11.915804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:11.915804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:11.915804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:11.915804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 250/511] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:11.916017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:11.936954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbdfa82-7ad9-4f7a-a277-19f066112cc0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:11.946053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:11.970951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:11.971560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:11.971834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:11.972103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:11.972834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:11.973136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:11.974610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.013837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 262/512] 10.222.0.48 () {56 vars in 1137 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:12.018618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.018704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302df33-a282-40d1-b6bb-57ca69a24d7d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.048829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.049435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.049712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.050005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.050640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:12.050940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.052308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.063693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 251/513] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:12.064472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.070228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:12.113713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd91a7-3e16-45fc-9368-3a5e2e4e1a7c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.148543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.149153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.149433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.149727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.150402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:12.150701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.152091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.152612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:12.162753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadf458-891f-42ea-af53-086ef79c0fe7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.163402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 263/514] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:12.164241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.197087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.197715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.198021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.198329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.205531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.206804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:12.218933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:12.219850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 252/515] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:12.220748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.267714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1b55b-abaf-406b-8149-3812bda6557c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.280889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:12.300859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.301463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.301738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.302036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.302677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:12.302976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.304438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.316053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 264/516] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:12.316988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.319760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adabf7a-683e-42f5-8fd7-b81dc6f06366 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.352502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca811e7a-a3f2-4d0d-a9c3-9f569bf3d88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.353106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca811e7a-a3f2-4d0d-a9c3-9f569bf3d88b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.353379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca811e7a-a3f2-4d0d-a9c3-9f569bf3d88b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.353642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca811e7a-a3f2-4d0d-a9c3-9f569bf3d88b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.371316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:12.415952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977ad39-f7f2-46f5-991b-fafea350f958 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.420536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca811e7a-a3f2-4d0d-a9c3-9f569bf3d88b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.422041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca811e7a-a3f2-4d0d-a9c3-9f569bf3d88b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.448665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.449288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.449568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.449869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.456314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.458077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:12.469610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:12.470683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 265/517] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:12.471748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.504384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:12.522541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 253/518] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:12.523444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca811e7a-a3f2-4d0d-a9c3-9f569bf3d88b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.573943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:12.576153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a12c1e-637c-4636-8cce-77302e3937cc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.609573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.610222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.610499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.610769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.618194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.619624 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.623061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca811e7a-a3f2-4d0d-a9c3-9f569bf3d88b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:12.630951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:12.632033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 266/519] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:12.633121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.662727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.663339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.663642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.664142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.664659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:12.664963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.666472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.683360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 254/520] 10.222.0.48 () {56 vars in 1139 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:12.684179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.724807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:12.731373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26316941-90a9-4fa5-80a7-13a83d182f60 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.763259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c8763-c43e-4b89-b028-e81238ecfeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.764219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c8763-c43e-4b89-b028-e81238ecfeae None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.764502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c8763-c43e-4b89-b028-e81238ecfeae None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.764771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c8763-c43e-4b89-b028-e81238ecfeae None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.765414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c8763-c43e-4b89-b028-e81238ecfeae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.766919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c8763-c43e-4b89-b028-e81238ecfeae None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.779594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4e9c2-da49-4c5e-a6d2-8055f7d4b51a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.788045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 267/521] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:24:12 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:12.788934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c8763-c43e-4b89-b028-e81238ecfeae None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.792303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:12.826788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.827419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.827700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.827972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.828678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:12.828977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.830524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.855255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 255/522] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:12.855255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.914088 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c8763-c43e-4b89-b028-e81238ecfeae None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.950634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:12.951335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:12.951556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:12.951794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:12.964429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:12.966552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:12.970634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd990d-7239-4509-ba68-c16875a74f92 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:12.982228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:12.983119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:12.983972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:12.983972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:12.983972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:12.983972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 268/523] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:12.984191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:12.987418 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.021967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.022593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.022912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.023191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:13.023991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:13.024227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:13.025708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:13.050102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 256/524] 10.222.0.48 () {56 vars in 1137 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:13.051224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:13.079349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.100455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6beae-bdeb-492a-8693-5a7c5b9a5422 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:13.137963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8e59-3141-410f-816b-847977d08ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.139434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8e59-3141-410f-816b-847977d08ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.140138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8e59-3141-410f-816b-847977d08ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.140552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd8e59-3141-410f-816b-847977d08ae1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:13.155118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243ec57-34d7-4af8-9500-6cde7fe68e8d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:13.191715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.192240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.192514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.192777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:13.193491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=fda0f612b2ec42b2beac9af0b49ccff0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:13.193818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:13.195291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:13.201120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 257/525] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:13 2022] GET /identity/v3/role_assignments?user.id=fda0f612b2ec42b2beac9af0b49ccff0&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:13.203042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:13.212980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd8e59-3141-410f-816b-847977d08ae1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:13.214694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd8e59-3141-410f-816b-847977d08ae1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:13.217206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.328023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.340704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65237f7a-078c-4fa4-a63f-a38781d83000 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:13.342414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 269/526] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:13.347831 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8e59-3141-410f-816b-847977d08ae1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:13.386754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.387437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.387718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.387988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:13.388997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:13.389294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:13.390739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:13.403768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 258/527] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:13.404709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:13.468137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd8e59-3141-410f-816b-847977d08ae1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:13.470065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.514266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91adb-9812-468b-8d15-98c8bd757f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.515128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91adb-9812-468b-8d15-98c8bd757f6f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.515243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c8e12-51e8-4ef6-a172-e13603ac21ab None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:13.515643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91adb-9812-468b-8d15-98c8bd757f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.516052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d91adb-9812-468b-8d15-98c8bd757f6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:13.561398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.562330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.563202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.563622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:13.578364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:13.580557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:13.591518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91adb-9812-468b-8d15-98c8bd757f6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:13.593134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d91adb-9812-468b-8d15-98c8bd757f6f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:13.600258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:13.601473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:13.602578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:13.602578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:13.602578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:13.604411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 259/528] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:13.605422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:13.612581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.724028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 270/529] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:13.725219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91adb-9812-468b-8d15-98c8bd757f6f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:13.728012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.735096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0de65c-1e8d-4bc6-9ef1-ba3921387351 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:13.779404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.781037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.781460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.781901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:13.791263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:13.793779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:13.809918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:13.810976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:13.811964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:13.811964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:13.811964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:13.811964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:13.811964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:13.811964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:13.811964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:13.811964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:13.814775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 260/530] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:13.816084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:13.846251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d91adb-9812-468b-8d15-98c8bd757f6f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:13.884006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.884608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.884885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.885150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:13.885829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:13.886123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:13.887676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:13.888996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.906857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 271/531] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:13.907769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:13.941647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7789552-e77a-459e-9f95-063483ad2ae4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:13.975404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:13.995039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:13.995914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:13.996328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:13.996759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.008653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.010509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:14.026388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:14.027326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:14.028195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:14.028195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:14.028195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:14.028798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223615a-5239-4db6-9574-36a8eb2ff450 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:14.034991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 261/532] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:14.036068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:14.071185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:14.071900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:14.072180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:14.072448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.073140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:14.073443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.075050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.095321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 272/533] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:14.096322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:14.148349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ab2f6-6027-4d66-939d-05aac2e2eefc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:14.164149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:14.188670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:14.190347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:14.191114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:14.191574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.201235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.203660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:14.220328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:14.221227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:14.222154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:14.222154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:14.222154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:14.222154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:14.222154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:14.222154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:14.222154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:14.222154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:14.228109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 262/534] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:14.228109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:14.235919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f030553-3389-46d6-bfe3-68a1fdbb0f5d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:14.264032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:14.279509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:14.280125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:14.280399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:14.280664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.281310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:14.281607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.283412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.299924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 273/535] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:14.300996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:14.350524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cad618-45de-44aa-b86d-19e6aa0c39c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:14.384478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:14.385102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:14.385415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:14.385685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.386548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=c46c91e383f44555b753b6500c9cdc44) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:14.386751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.388163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.394047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 263/536] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:14 2022] GET /identity/v3/role_assignments?user.id=c46c91e383f44555b753b6500c9cdc44&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:14.394911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:14.412210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905d45-5e2d-4bfd-92d2-7021be5ace28 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:14.462646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:14.463757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:14.464227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:14.464702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.466891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:14.467450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.468045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:14.470730 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.500732 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 274/537] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:14.509080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:14.581721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704b31f-1ffa-44f0-94b8-99fcaf8bd901 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:14.620734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:14.621398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:14.621700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:14.622026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.623911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:14.629628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.631789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:14.643355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:14.644375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:14.645448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:14.645448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:14.645448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:14.645448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:14.645448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:14.645448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:14.645448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:14.645448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:14.652100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 264/538] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:14.653437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:14.732498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481db7c8-f67d-48f6-abdf-b8cb2101e6e0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:14.801002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:14.801893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:14.802311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:14.802718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.804002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=18061b868be44122a849e2e239b56f60) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:14.804556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.806536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.813563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 275/539] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:14 2022] GET /identity/v3/role_assignments?user.id=18061b868be44122a849e2e239b56f60&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:14.815021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:14.827849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd00ab2-2c44-4dcf-b726-410b61ea3a75 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:14.890517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcde2b-1f44-448c-a49b-97206e0446ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:14.891191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcde2b-1f44-448c-a49b-97206e0446ca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:14.891428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcde2b-1f44-448c-a49b-97206e0446ca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:14.891659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcde2b-1f44-448c-a49b-97206e0446ca None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:14.892445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcde2b-1f44-448c-a49b-97206e0446ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:14.892741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcde2b-1f44-448c-a49b-97206e0446ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:14.894216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcde2b-1f44-448c-a49b-97206e0446ca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:14.915791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 265/540] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:14.925000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:15.073241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d81b4-8f0f-4005-9350-c8138866cee3 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:15.073419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d81b4-8f0f-4005-9350-c8138866cee3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:15.073693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d81b4-8f0f-4005-9350-c8138866cee3 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:15.075293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 266/541] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:15.086751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef33dc65-2bba-4c5d-9608-f0fd3a0c218b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:15.087300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06d4c-f002-441d-ba77-ce72ccc5b437 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:15.087572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06d4c-f002-441d-ba77-ce72ccc5b437 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:15.087752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06d4c-f002-441d-ba77-ce72ccc5b437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:15.094501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:15.107280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a2f06d4c-f002-441d-ba77-ce72ccc5b437 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:15.108503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a2f06d4c-f002-441d-ba77-ce72ccc5b437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:15.130377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:15.130999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:15.131284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:15.131554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:15.132491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=0cd4b1beb0b149ceba9940a0631f23b0) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:15.132804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:15.134324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:15.154346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 276/542] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:14 2022] GET /identity/v3/role_assignments?user.id=0cd4b1beb0b149ceba9940a0631f23b0&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:15.199203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 267/543] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:15.593609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:15.603846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748cd5-e389-443d-9241-c43547a0cc6c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:15.607632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748cd5-e389-443d-9241-c43547a0cc6c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:15.608125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef748cd5-e389-443d-9241-c43547a0cc6c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:15.610314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 268/544] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:15 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:15.621526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183a6b-f9c6-476b-9f52-7075c31bad6e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:15.623538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183a6b-f9c6-476b-9f52-7075c31bad6e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:15.624920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07183a6b-f9c6-476b-9f52-7075c31bad6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:15.656906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-07183a6b-f9c6-476b-9f52-7075c31bad6e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:15.658998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-07183a6b-f9c6-476b-9f52-7075c31bad6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:15.764237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 269/545] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:24:15.794123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d007225b-0bdc-4e58-912b-338bb636eb61 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:15.848534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450d4c4-ab8a-4037-b1f8-fc6453174103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:15.849098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450d4c4-ab8a-4037-b1f8-fc6453174103 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:15.849379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450d4c4-ab8a-4037-b1f8-fc6453174103 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:15.849655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1450d4c4-ab8a-4037-b1f8-fc6453174103 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:15.866782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1450d4c4-ab8a-4037-b1f8-fc6453174103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1450d4c4-ab8a-4037-b1f8-fc6453174103 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:15.872180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:15.873069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:15.873906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 277/546] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:15.880991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183a6b-f9c6-476b-9f52-7075c31bad6e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:15.914537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:16.040429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07183a6b-f9c6-476b-9f52-7075c31bad6e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:16.082301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:16.082918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.083194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.083462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.084119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:16.084416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:16.085886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:16.094432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 270/547] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:16.099995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450d4c4-ab8a-4037-b1f8-fc6453174103 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:16.131068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:16.158224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:16.250430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:16.272237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a80d9-7577-4307-98b8-52409b580000 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:16.311777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eb731-cc3c-4573-8bc2-b6ff4a69a4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:16.315394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eb731-cc3c-4573-8bc2-b6ff4a69a4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.315394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eb731-cc3c-4573-8bc2-b6ff4a69a4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.315394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2eb731-cc3c-4573-8bc2-b6ff4a69a4d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.324215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1450d4c4-ab8a-4037-b1f8-fc6453174103 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:16.340574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2eb731-cc3c-4573-8bc2-b6ff4a69a4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ad2eb731-cc3c-4573-8bc2-b6ff4a69a4d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:16.346085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:16.347509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:16.348835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:16.352860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 271/548] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:16.358364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eb731-cc3c-4573-8bc2-b6ff4a69a4d2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:16.410504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:16.411159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.411439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.411726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.438868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:16.445248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:16.469216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:16.470847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:16.471909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:16.471909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:16.471909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:16.473631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 278/549] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:16.480351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:16.498342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2eb731-cc3c-4573-8bc2-b6ff4a69a4d2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:16.566041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e3304-811b-499e-93e3-39dae770defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:16.566908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e3304-811b-499e-93e3-39dae770defd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.568273 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e3304-811b-499e-93e3-39dae770defd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.568724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e3304-811b-499e-93e3-39dae770defd None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.570185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e3304-811b-499e-93e3-39dae770defd None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:16.571673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e3304-811b-499e-93e3-39dae770defd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:16.574326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e3304-811b-499e-93e3-39dae770defd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:16.592168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 272/550] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:16.597913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e3304-811b-499e-93e3-39dae770defd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:16.601382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:16.651523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:16.692261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29837f01-89bb-4e44-9fa9-66cbb53484a4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:16.732430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:16.733049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.733326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.733597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.734274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:16.734575 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:16.735947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:16.748610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 279/551] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:16.754127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:16.777989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e3304-811b-499e-93e3-39dae770defd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:16.811817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f202d5-7d89-4141-8520-edb7c80896cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:16.812459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f202d5-7d89-4141-8520-edb7c80896cd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.812734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f202d5-7d89-4141-8520-edb7c80896cd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.813008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f202d5-7d89-4141-8520-edb7c80896cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.823883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f202d5-7d89-4141-8520-edb7c80896cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:16.825387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f202d5-7d89-4141-8520-edb7c80896cd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b1f202d5-7d89-4141-8520-edb7c80896cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:16.841003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:16.842169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:16.843055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:16.843055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:16.843055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:16.843055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 273/552] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:16.843693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a6212-b7bc-47bc-969b-3f29e221cb33 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.848587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a6212-b7bc-47bc-969b-3f29e221cb33 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.849079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a6212-b7bc-47bc-969b-3f29e221cb33 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.851652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 274/553] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:16.852419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a6212-b7bc-47bc-969b-3f29e221cb33 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:16.876265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea39b40-c5b5-4655-83ff-a65ab2978e8a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:16.920442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1528755-14b7-419c-8bd8-b78879bdfaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:16.920779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:16.921276 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528755-14b7-419c-8bd8-b78879bdfaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.921431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528755-14b7-419c-8bd8-b78879bdfaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.925774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528755-14b7-419c-8bd8-b78879bdfaf4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.931636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1528755-14b7-419c-8bd8-b78879bdfaf4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:16.933104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1528755-14b7-419c-8bd8-b78879bdfaf4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b1528755-14b7-419c-8bd8-b78879bdfaf4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:16.948674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:16.950647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 280/554] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad9131-9345-43df-ad93-de8d2ede7fcb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:16.952594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad9131-9345-43df-ad93-de8d2ede7fcb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:16.953572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad9131-9345-43df-ad93-de8d2ede7fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:16.960460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:16.975266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556a6212-b7bc-47bc-969b-3f29e221cb33 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:16.977502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-78ad9131-9345-43df-ad93-de8d2ede7fcb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:16.978973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-78ad9131-9345-43df-ad93-de8d2ede7fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:17.023620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:17.024599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.025014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.025421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.026284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:17.026720 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:17.029625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:17.044889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 275/555] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:17.046035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:17.081843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 281/556] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:17.081843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad9131-9345-43df-ad93-de8d2ede7fcb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:17.223580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ad603-225c-418e-b338-041ffd529fd8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:17.255210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:17.261148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad9131-9345-43df-ad93-de8d2ede7fcb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:17.294244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:17.300623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98747551-eb61-4696-b558-77d41cd0ba65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:17.301328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747551-eb61-4696-b558-77d41cd0ba65 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.301649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747551-eb61-4696-b558-77d41cd0ba65 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.302023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98747551-eb61-4696-b558-77d41cd0ba65 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.306584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d9fae-f8c1-4af8-82c7-6a77c29653d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:17.307258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d9fae-f8c1-4af8-82c7-6a77c29653d5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.307535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d9fae-f8c1-4af8-82c7-6a77c29653d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.307808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d9fae-f8c1-4af8-82c7-6a77c29653d5 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.308550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d9fae-f8c1-4af8-82c7-6a77c29653d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:17.308853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d9fae-f8c1-4af8-82c7-6a77c29653d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:17.310324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98747551-eb61-4696-b558-77d41cd0ba65 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:17.310434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d9fae-f8c1-4af8-82c7-6a77c29653d5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:17.311805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98747551-eb61-4696-b558-77d41cd0ba65 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-98747551-eb61-4696-b558-77d41cd0ba65 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:17.328574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:17.330060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:17.331031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 282/557] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:17.331644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0b1a-e84a-4aab-b23f-30c38803a2b9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.331644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0b1a-e84a-4aab-b23f-30c38803a2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.331774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0b1a-e84a-4aab-b23f-30c38803a2b9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.337192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 283/558] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:17.338004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c0b1a-e84a-4aab-b23f-30c38803a2b9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:17.340020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 276/559] 10.222.0.48 () {56 vars in 1135 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:17.341495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e93bcb-400c-4802-9f14-6a6a750d4903 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.341794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e93bcb-400c-4802-9f14-6a6a750d4903 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.342171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e93bcb-400c-4802-9f14-6a6a750d4903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.361176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-75e93bcb-400c-4802-9f14-6a6a750d4903 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:17.362396 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-75e93bcb-400c-4802-9f14-6a6a750d4903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:17.434788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 277/560] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:17.435652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e93bcb-400c-4802-9f14-6a6a750d4903 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:17.463967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c0b1a-e84a-4aab-b23f-30c38803a2b9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:17.510301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:17.511424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.512109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.512667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.514570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:17.515051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:17.516909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:17.541862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 284/561] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:17.543094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:17.568940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e93bcb-400c-4802-9f14-6a6a750d4903 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:17.571120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:17.604559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:17.606773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab1059-8a6e-41d6-9fa7-b3b03000aadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:17.607395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab1059-8a6e-41d6-9fa7-b3b03000aadb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.607675 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab1059-8a6e-41d6-9fa7-b3b03000aadb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.608100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab1059-8a6e-41d6-9fa7-b3b03000aadb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.661429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708cc70f-06d5-49f8-a8ec-98648f2a71c4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:17.676840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab1059-8a6e-41d6-9fa7-b3b03000aadb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:17.678466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ab1059-8a6e-41d6-9fa7-b3b03000aadb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:17.699631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a499e1-95f6-4c79-80b8-2e058e41820a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:17.700261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a499e1-95f6-4c79-80b8-2e058e41820a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.700531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a499e1-95f6-4c79-80b8-2e058e41820a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.700792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a499e1-95f6-4c79-80b8-2e058e41820a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.712515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a499e1-95f6-4c79-80b8-2e058e41820a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-61a499e1-95f6-4c79-80b8-2e058e41820a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:17.717270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:17.718224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 285/562] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:17.719683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a499e1-95f6-4c79-80b8-2e058e41820a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:17.791282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 278/563] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:17.792103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab1059-8a6e-41d6-9fa7-b3b03000aadb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:17.794448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:17.830008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a499e1-95f6-4c79-80b8-2e058e41820a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:17.842497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:17.870026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:17.870683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.870960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.871226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.883491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:17.885013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:17.900863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:17.901919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:17.902825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:17.902825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:17.902825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:17.902825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 286/564] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:17.902825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:17.904955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab1059-8a6e-41d6-9fa7-b3b03000aadb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:17.940929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32b8b7-a700-4dd1-8e37-7064b69ffbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:17.941569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32b8b7-a700-4dd1-8e37-7064b69ffbc8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:17.941854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32b8b7-a700-4dd1-8e37-7064b69ffbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:17.942121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32b8b7-a700-4dd1-8e37-7064b69ffbc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:17.952090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32b8b7-a700-4dd1-8e37-7064b69ffbc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-de32b8b7-a700-4dd1-8e37-7064b69ffbc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:17.956820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:17.957743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:17.958646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 279/565] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:17.959343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32b8b7-a700-4dd1-8e37-7064b69ffbc8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.012334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682b88-bd1c-4dc1-abe9-68f4cd4a6615 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.021982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.044883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.045412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.045684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.045980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.046637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:18.046934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.048295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.059803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32b8b7-a700-4dd1-8e37-7064b69ffbc8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.060112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 287/566] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:18.061202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.086322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.093014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.093636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.093937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.094200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.104112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.105580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:18.119479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:18.120585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:18.121485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:18.121485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:18.121485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:18.121485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 280/567] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:18.121485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.164192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6ef20-51b5-4d11-a4ee-0644f319a5ec None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.197075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12011b6-5671-4a07-95c3-ba5eac716bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.197701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12011b6-5671-4a07-95c3-ba5eac716bac None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.198012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12011b6-5671-4a07-95c3-ba5eac716bac None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.198280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12011b6-5671-4a07-95c3-ba5eac716bac None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.198922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12011b6-5671-4a07-95c3-ba5eac716bac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:18.199219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12011b6-5671-4a07-95c3-ba5eac716bac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.200589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12011b6-5671-4a07-95c3-ba5eac716bac None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.212467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 288/568] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:18.213633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3facc82-ebb7-41d8-bc4d-eaf98e458969 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.213949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3facc82-ebb7-41d8-bc4d-eaf98e458969 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.214246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3facc82-ebb7-41d8-bc4d-eaf98e458969 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.215403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 289/569] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:18.216090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3facc82-ebb7-41d8-bc4d-eaf98e458969 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.226428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9a863-309e-42ee-bf3a-111f29c9ca9c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.240335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.259516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.260338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.260615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.260883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.261538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:18.261864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.263613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.271183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 281/570] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:18.271962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.307044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.324280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3facc82-ebb7-41d8-bc4d-eaf98e458969 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.357983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.358607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.358881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.359144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.368892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.370390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.373064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c329b0-f074-4307-91d1-e235f258c626 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:18.384460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:18.385453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:18.386408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:18.386408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:18.386408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:18.386408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 290/571] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:18.386408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.408483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b1751-fee2-425d-b646-2eee310e5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.409099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1751-fee2-425d-b646-2eee310e5df0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.409369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1751-fee2-425d-b646-2eee310e5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.409637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b1751-fee2-425d-b646-2eee310e5df0 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.410299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b1751-fee2-425d-b646-2eee310e5df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:18.410596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b1751-fee2-425d-b646-2eee310e5df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.411968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b1751-fee2-425d-b646-2eee310e5df0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.423745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 282/572] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:18.424889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc314-39a4-4622-9968-90b62e24647f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.425170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc314-39a4-4622-9968-90b62e24647f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.425432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52dc314-39a4-4622-9968-90b62e24647f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.442414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c52dc314-39a4-4622-9968-90b62e24647f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:18.443605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c52dc314-39a4-4622-9968-90b62e24647f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:18.471260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.488460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f794d4-cb40-4582-93a5-3c82578b848b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.508560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 283/573] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:18.509476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dc314-39a4-4622-9968-90b62e24647f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.532036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.532654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.532934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.533202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.536917 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.542194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.543711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:18.557858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:18.558772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 291/574] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:18.559692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.618867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52dc314-39a4-4622-9968-90b62e24647f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.654759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.655603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.656036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.656305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.663104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8ed770-39d3-4cb5-af5b-6e9b145a514b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.666393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.667875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:18.684080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:18.685077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:18.686009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:18.686009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:18.686009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:18.686009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 284/575] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:18.686644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.704320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.704846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.705122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.705388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.706314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:18.706423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.707745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.710789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.719825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 292/576] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:18.720725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.777108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.799222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7088472-83f4-4caf-9ba8-51cdc7f23a9b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.819033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98369847-4ca7-4f98-b067-79ad6fed68f5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.832246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.832882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.833167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.833428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.839976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.841452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.851770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.852376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:18.852588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:18.853633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:18.854775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:18.854775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:18.854775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:18.854775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:18.854775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:18.854775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:18.854775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:18.854775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:18.855248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.855248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.855248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:18.855430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 285/577] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:18.855430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.856019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.857472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:18.869250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 293/578] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:18.870263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:18.932930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.954242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2c905-9f6d-49b0-996a-22e6778f37a2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.966813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710fd8b9-8683-4e6d-b791-2068770812c4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:18.983068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:18.992743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:18.993359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:18.993634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:18.993945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:18.994610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:18.994907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:18.996289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.000557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.001178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.001454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.001719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.008019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 286/579] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:19.008621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.013538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.015035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:19.026152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:19.027119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:19.028090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 294/580] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:19.028780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.108249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a94001-e5d9-43e9-bbc9-346eccf53a5c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.124341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d46f2-e695-4101-b4d4-3a5f03115188 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.141263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3f1fb-0b11-4afe-b4b6-aed4103c818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.141902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3f1fb-0b11-4afe-b4b6-aed4103c818b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.142177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3f1fb-0b11-4afe-b4b6-aed4103c818b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.142442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3f1fb-0b11-4afe-b4b6-aed4103c818b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.149112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:19.153407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3f1fb-0b11-4afe-b4b6-aed4103c818b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:19.158093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-abf3f1fb-0b11-4afe-b4b6-aed4103c818b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:19.158225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:19.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:19.160415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:19.161202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.161202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.161202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.161202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:19.161202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.161588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.164350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 287/581] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:19.165186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3f1fb-0b11-4afe-b4b6-aed4103c818b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.173687 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 295/582] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:19.174514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.207829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:19.267977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3f1fb-0b11-4afe-b4b6-aed4103c818b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.273196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a9dac-9f33-43b6-9eb5-3e9e05ccae26 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.300740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99cf75-c31e-40af-b48e-3f6655f68b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.301387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99cf75-c31e-40af-b48e-3f6655f68b21 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.301659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99cf75-c31e-40af-b48e-3f6655f68b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.301954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa99cf75-c31e-40af-b48e-3f6655f68b21 None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/fda0f612b2ec42b2beac9af0b49ccff0/roles/92f1f6b31904491bb73824b634599912` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.305852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.306463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.306739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.307004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.313800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.315237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.316221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99cf75-c31e-40af-b48e-3f6655f68b21 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=fda0f612b2ec42b2beac9af0b49ccff0, role_id=92f1f6b31904491bb73824b634599912)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.317647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa99cf75-c31e-40af-b48e-3f6655f68b21 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:19.327244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:19.328429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 296/583] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:19.330160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.336357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 288/584] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:24:19 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/fda0f612b2ec42b2beac9af0b49ccff0/roles/92f1f6b31904491bb73824b634599912 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:24:19.337169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99cf75-c31e-40af-b48e-3f6655f68b21 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.401656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:19.445457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:19.453332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a3d24-944b-43aa-8dba-22ca9c33b69a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.461889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa99cf75-c31e-40af-b48e-3f6655f68b21 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.498013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.498629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.498896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.499161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.499897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:19.500195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.500823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.501437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.501642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.501737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.501998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.502667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:19.502960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.504340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.513955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 289/585] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:19.514355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.529492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 297/586] 10.222.0.48 () {56 vars in 1137 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:19.530547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.620113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844e182-7802-4e02-be82-edeeaa25ce5a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.631205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:19.631479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f0fcbc-8800-466c-9ea5-cbf991a1a9e4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.656005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.656533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.656807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.657075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.657855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=004e85a47ddd40f89d65bc5ffa817dc6) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:19.658158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.659588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.665354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 290/587] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/role_assignments?user.id=004e85a47ddd40f89d65bc5ffa817dc6&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:19.666184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.675755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.676380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.676656 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.676924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.677671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:19.678009 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.679625 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.702784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 298/588] 10.222.0.48 () {56 vars in 1139 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:19.703865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.721722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:19.795086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600acbf4-191b-4fe1-8146-d812bfe5e9cf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.836542 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c5d3d3-c6e2-4c41-8a7f-2ea2a0787757 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:19.836755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.837517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.837884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.838481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.855188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.857466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:19.878217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:19.879256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:19.880192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:19.880192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:19.880192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:19.880362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:19.880362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:19.880362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:19.880362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:19.884394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 291/589] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:19.885661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.895409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:19.897306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:19.916260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:19.917249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:19.918237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:19.918237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:19.918237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:19.922035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 299/590] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:19.922942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:19.927882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:19.999704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:20.032624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eac7ef-4eaf-4730-bfad-e8284142164c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.049916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718a8ac-628d-4bb2-93e3-c6b5b4f1955b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.067562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.068281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.068944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.068944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.080244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.081854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.093484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.094375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.094828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.095267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.096107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:20.096589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:20.097409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:20.098389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:20.099306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:20.099306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:20.099306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:20.099306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 292/591] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:20.100108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.100640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.116047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 300/592] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:20.117184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.186244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:20.210995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ed91e-80a4-4ee2-937c-17509add73a9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.244639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc18fea-ee34-4055-99d0-dccb3f337a9d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.251877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.252683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.253692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.254126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.254968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:20.255854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.258119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.270821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:20.275613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 293/593] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:20.276645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.286459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.287187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.287556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.287919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.288752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:20.289140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.290980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.302837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 301/594] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:20.303829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.408464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b864a13-0e05-43cb-91aa-6ac286cae846 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.420280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d19e05-316d-4ee3-b6d7-7d400510e560 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.445146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.445881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.446267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.446624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.454968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.456534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.458571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:20.469034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.469904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.470354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.470851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:20.471322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:20.472445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 03:24:20.473628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:20.480745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 294/595] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:20.481686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.482173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.483773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:20.499763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:20.500882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:20.502046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:20.502046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:20.502046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:20.502046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:20.502046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:20.502046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:20.502046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:20.502046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:20.504429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 302/596] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:20.505382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.568535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:20.592687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74650ac6-9ca9-41ef-81f1-abc757b31e30 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.637471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.638891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.639261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.639644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.641250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d537d67-9420-41bd-ae3f-d838c4e4ce90 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.648007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.650013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:20.663770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:20.664837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:20.665858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:20.665858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:20.665858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:20.665858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:20.665858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:20.665858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:20.665858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:20.665858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:20.666302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 295/597] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:20.667357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.681817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.682688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.683215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.683731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.684807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:20.685308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.687563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.707477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 303/598] 10.222.0.48 () {56 vars in 1137 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:20.708642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.743050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:20.788746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c844f714-f846-4f38-98a0-9ea499287322 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.825169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.825630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74529eb6-4fa1-4c7d-bd10-653288c2a1f5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.826443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.826933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.827349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:20.827820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.829000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:20.829557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.831237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.845742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 296/599] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:20.847004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.868357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:20.869351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:20.869860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:20.870344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:20.871231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:20.871728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:20.873985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:20.887554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 304/600] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:20.889102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:20.968654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21108144-e154-47c1-a66f-1bc718a3b8df None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:20.992623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:21.010388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:21.011027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.011304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.011569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.018535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f02acf-855f-482f-b12d-1a9a46c36b5b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:21.022419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:21.023980 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:21.039358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:21.040763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:21.041643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:21.041643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:21.041643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:21.045485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 297/601] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:21.046301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:21.060578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d8db-70ca-42f1-afc9-ee9fe6dc4e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:21.061866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d8db-70ca-42f1-afc9-ee9fe6dc4e7b None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.062374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d8db-70ca-42f1-afc9-ee9fe6dc4e7b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.063333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56d8db-70ca-42f1-afc9-ee9fe6dc4e7b None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/c46c91e383f44555b753b6500c9cdc44/roles/92f1f6b31904491bb73824b634599912` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.080993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56d8db-70ca-42f1-afc9-ee9fe6dc4e7b None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=c46c91e383f44555b753b6500c9cdc44, role_id=92f1f6b31904491bb73824b634599912)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:21.082852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56d8db-70ca-42f1-afc9-ee9fe6dc4e7b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:21.104666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 305/602] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:24:20 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/c46c91e383f44555b753b6500c9cdc44/roles/92f1f6b31904491bb73824b634599912 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:24:21.106846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d8db-70ca-42f1-afc9-ee9fe6dc4e7b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:21.139989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:21.188524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661716bc-b263-450b-9a8f-dab44b5fa779 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:21.257346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d9f5-357c-41de-b21a-e0222ece82b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:21.257965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d9f5-357c-41de-b21a-e0222ece82b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.258242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d9f5-357c-41de-b21a-e0222ece82b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.258510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31d9f5-357c-41de-b21a-e0222ece82b6 None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/18061b868be44122a849e2e239b56f60/roles/92f1f6b31904491bb73824b634599912` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.292830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31d9f5-357c-41de-b21a-e0222ece82b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=18061b868be44122a849e2e239b56f60, role_id=92f1f6b31904491bb73824b634599912)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:21.294363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31d9f5-357c-41de-b21a-e0222ece82b6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:21.317476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56d8db-70ca-42f1-afc9-ee9fe6dc4e7b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:21.318467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 298/603] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:24:21 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/18061b868be44122a849e2e239b56f60/roles/92f1f6b31904491bb73824b634599912 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:24:21.367587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3186d1-f743-422e-987c-cdf97860032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:21.368220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3186d1-f743-422e-987c-cdf97860032b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.368492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3186d1-f743-422e-987c-cdf97860032b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.368761 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3186d1-f743-422e-987c-cdf97860032b None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.369419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3186d1-f743-422e-987c-cdf97860032b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:21.369716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3186d1-f743-422e-987c-cdf97860032b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:21.371134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3186d1-f743-422e-987c-cdf97860032b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:21.393203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 306/604] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:21.398792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d9f5-357c-41de-b21a-e0222ece82b6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:21.436735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:21.526525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31d9f5-357c-41de-b21a-e0222ece82b6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:21.563986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:21.564632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.564911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.565181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.572234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:21.573821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:21.579371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999303eb-9929-4def-a4b5-d426b09fb088 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.579873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999303eb-9929-4def-a4b5-d426b09fb088 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.579977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999303eb-9929-4def-a4b5-d426b09fb088 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.581413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 307/605] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:21.586343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:21.587248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:21.588177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 299/606] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:21.589958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4db1-7bed-46e2-8696-e4b097a2b06f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.590240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4db1-7bed-46e2-8696-e4b097a2b06f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.590508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f4db1-7bed-46e2-8696-e4b097a2b06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.593281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:21.626139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-086f4db1-7bed-46e2-8696-e4b097a2b06f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:21.627324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-086f4db1-7bed-46e2-8696-e4b097a2b06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:21.707547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 308/607] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:21.719511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:21.746986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf17b68-494d-40bf-9902-239305916a6e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:21.806530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:21.807153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.807490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.807820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.808583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:21.808947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:21.810468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:21.832730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 300/608] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:21.838904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4db1-7bed-46e2-8696-e4b097a2b06f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:21.843847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:21.945822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f4db1-7bed-46e2-8696-e4b097a2b06f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:21.987679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38593247-3bf6-48c1-b010-fea169b80b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:21.987679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38593247-3bf6-48c1-b010-fea169b80b68 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:21.987679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38593247-3bf6-48c1-b010-fea169b80b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:21.987679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38593247-3bf6-48c1-b010-fea169b80b68 None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/0cd4b1beb0b149ceba9940a0631f23b0/roles/92f1f6b31904491bb73824b634599912` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:21.992069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:22.012080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38593247-3bf6-48c1-b010-fea169b80b68 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=0cd4b1beb0b149ceba9940a0631f23b0, role_id=92f1f6b31904491bb73824b634599912)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:22.013926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38593247-3bf6-48c1-b010-fea169b80b68 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:22.037799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 309/609] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:24:21 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/0cd4b1beb0b149ceba9940a0631f23b0/roles/92f1f6b31904491bb73824b634599912 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:24:22.146379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abfec3-2bb0-42ef-97b6-077db281cf68 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:22.203323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164da7e-d45b-4ebd-89f6-6f8770755260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:22.203978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164da7e-d45b-4ebd-89f6-6f8770755260 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:22.204255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164da7e-d45b-4ebd-89f6-6f8770755260 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:22.204522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164da7e-d45b-4ebd-89f6-6f8770755260 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:22.218718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:22.221837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164da7e-d45b-4ebd-89f6-6f8770755260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5164da7e-d45b-4ebd-89f6-6f8770755260 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:22.226787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:22.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:22.228742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 301/610] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:22.234889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38593247-3bf6-48c1-b010-fea169b80b68 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:22.302456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18d55d-2809-422f-8d11-c872dd9ef4ce None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:22.302784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18d55d-2809-422f-8d11-c872dd9ef4ce None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:22.303042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b18d55d-2809-422f-8d11-c872dd9ef4ce None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:22.304738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 302/611] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:22.310608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0ec7-d6fc-4d3c-8ab0-5db5cf3e3336 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:22.310889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0ec7-d6fc-4d3c-8ab0-5db5cf3e3336 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:22.311159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b0ec7-d6fc-4d3c-8ab0-5db5cf3e3336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:22.316407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:22.334858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7b7b0ec7-d6fc-4d3c-8ab0-5db5cf3e3336 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:22.337020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7b7b0ec7-d6fc-4d3c-8ab0-5db5cf3e3336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:22.369670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38593247-3bf6-48c1-b010-fea169b80b68 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:22.418020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:22.418553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:22.418824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:22.419089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:22.419755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:22.420052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:22.421420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:22.424994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 303/612] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:24:22.440189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 310/613] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:22.445991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b0ec7-d6fc-4d3c-8ab0-5db5cf3e3336 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:22.573910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b0ec7-d6fc-4d3c-8ab0-5db5cf3e3336 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:22.614394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:22.625248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:22.625927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:22.626206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:22.626480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:22.640514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:22.641990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:22.656890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:22.657914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:22.658843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:22.658843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:22.658843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:22.658843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 304/614] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:22.664111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:22.816743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f949f3-977f-40d7-8c6f-950efcd801a8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:22.832368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:22.858493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:22.859111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:22.859395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:22.859660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:22.860305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:22.860608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:22.862002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:22.882386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 311/615] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:22.887663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:22.910888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:23.062206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43296476-ecb4-421f-8a01-af791f31bd76 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:23.084546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ad420-1dde-4293-aad3-8b0e32eb3be9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:23.107972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:23.108619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.108893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.110202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.128458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:23.129984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:23.152333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:23.153791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:23.154770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 305/616] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:24:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:23.156865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d495f3-2dd0-4803-82fe-f8807ade07ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:23.157508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d495f3-2dd0-4803-82fe-f8807ade07ec None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.157806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d495f3-2dd0-4803-82fe-f8807ade07ec None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.158146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d495f3-2dd0-4803-82fe-f8807ade07ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.161584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:23.178672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d495f3-2dd0-4803-82fe-f8807ade07ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e1d495f3-2dd0-4803-82fe-f8807ade07ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:23.183655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:23.185837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:23.187934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 312/617] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:23.194256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d495f3-2dd0-4803-82fe-f8807ade07ec None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:23.226776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:23.262134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:23.296142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d495f3-2dd0-4803-82fe-f8807ade07ec None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:23.330520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:23.331133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.331411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.331679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.332339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:23.332638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:23.334033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:23.340393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12512886-de58-4cde-8d79-d84cae6edf28 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:23.342401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 313/618] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:23.347941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:23.375605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:23.376261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.376543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.376814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.377545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:23.377896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:23.379344 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:23.399900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 306/619] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:24:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:23.405210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:23.532787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea57698-a1b9-4651-9c58-44c90783096e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:23.541967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:23.583296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7797150-e87e-4b34-9f61-76b6b7694cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:23.585358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797150-e87e-4b34-9f61-76b6b7694cad None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.585636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797150-e87e-4b34-9f61-76b6b7694cad None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.587024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7797150-e87e-4b34-9f61-76b6b7694cad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.588007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:23.604086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0368186-6e74-451a-9082-38271bc6bd25 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:23.677420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d14235-a955-4873-af96-b39e4461fa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:23.678140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d14235-a955-4873-af96-b39e4461fa1e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.678374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d14235-a955-4873-af96-b39e4461fa1e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.678618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d14235-a955-4873-af96-b39e4461fa1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.693221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d14235-a955-4873-af96-b39e4461fa1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:23.695076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d14235-a955-4873-af96-b39e4461fa1e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-20d14235-a955-4873-af96-b39e4461fa1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:23.714006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:23.715062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:23.716016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:23.716016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:23.716016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:23.716016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 314/620] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:23.716678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595696-0fef-4cc0-a871-789f13c0a1d9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.716678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595696-0fef-4cc0-a871-789f13c0a1d9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.716962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81595696-0fef-4cc0-a871-789f13c0a1d9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.722240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 315/621] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:23.723041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81595696-0fef-4cc0-a871-789f13c0a1d9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:23.724095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7797150-e87e-4b34-9f61-76b6b7694cad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:23.725959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7797150-e87e-4b34-9f61-76b6b7694cad None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:23.827203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81595696-0fef-4cc0-a871-789f13c0a1d9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:23.834487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:23.839753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 307/622] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:23.841131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9a5b7-af66-4d36-942e-31f602105813 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.841411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9a5b7-af66-4d36-942e-31f602105813 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.841686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9a5b7-af66-4d36-942e-31f602105813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.860739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f8e9a5b7-af66-4d36-942e-31f602105813 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:23.861891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f8e9a5b7-af66-4d36-942e-31f602105813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:23.868942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:23.869568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:23.869874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:23.870148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:23.870849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:23.871153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:23.872568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:23.886721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 316/623] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:23.887633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:23.898847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:23.937787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 308/624] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:23.937787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9a5b7-af66-4d36-942e-31f602105813 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.040693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9a5b7-af66-4d36-942e-31f602105813 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.071932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:24.078465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.079125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.079403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.079676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.089280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:24.090788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:24.093911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d9cf50-b790-429f-a803-724a6ad8b2f0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:24.114371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:24.116604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:24.118582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 309/625] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:24.126781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.148626 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d2128-3720-45b5-b370-b583828b3993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.149271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2128-3720-45b5-b370-b583828b3993 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.149547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2128-3720-45b5-b370-b583828b3993 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.149837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d2128-3720-45b5-b370-b583828b3993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.169085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d2128-3720-45b5-b370-b583828b3993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:24.170835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d2128-3720-45b5-b370-b583828b3993 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-870d2128-3720-45b5-b370-b583828b3993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:24.185788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:24.186792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:24.188351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:24.188351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:24.188351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:24.188351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 317/626] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:24.188351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34799-b3d6-43fc-8dd4-a81d2a7d629e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.188649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34799-b3d6-43fc-8dd4-a81d2a7d629e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.188941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef34799-b3d6-43fc-8dd4-a81d2a7d629e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.193794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 318/627] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:24.193794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef34799-b3d6-43fc-8dd4-a81d2a7d629e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.255678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00851e0f-19dd-46c1-be59-8fa85d2fbaad None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.270215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:24.294045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2483b5-6987-44ce-bebe-15ad4a10060b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.294663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2483b5-6987-44ce-bebe-15ad4a10060b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.294943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2483b5-6987-44ce-bebe-15ad4a10060b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.295215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2483b5-6987-44ce-bebe-15ad4a10060b None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.295942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2483b5-6987-44ce-bebe-15ad4a10060b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:24.296267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2483b5-6987-44ce-bebe-15ad4a10060b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:24.297676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2483b5-6987-44ce-bebe-15ad4a10060b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:24.312561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef34799-b3d6-43fc-8dd4-a81d2a7d629e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.315455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 310/628] 10.222.0.48 () {56 vars in 1135 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:24.316749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80235-d387-4bd3-9ba5-68bc5f055271 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.317037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80235-d387-4bd3-9ba5-68bc5f055271 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.317310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80235-d387-4bd3-9ba5-68bc5f055271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.335223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2cf80235-d387-4bd3-9ba5-68bc5f055271 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:24.336499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2cf80235-d387-4bd3-9ba5-68bc5f055271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:24.356525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.357160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.357437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.357708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.358405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:24.358712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:24.360136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:24.377637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 319/629] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:24.377637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.388851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:24.413016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 311/630] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:24.420704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80235-d387-4bd3-9ba5-68bc5f055271 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.491274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63479dce-a4a2-4dae-b465-3a4c932b66c6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.512491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:24.527118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80235-d387-4bd3-9ba5-68bc5f055271 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.529328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0cea4-dece-4757-9449-f5cb9eb2cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.530287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cea4-dece-4757-9449-f5cb9eb2cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.530287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cea4-dece-4757-9449-f5cb9eb2cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.530559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0cea4-dece-4757-9449-f5cb9eb2cdf4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.541208 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad0cea4-dece-4757-9449-f5cb9eb2cdf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0ad0cea4-dece-4757-9449-f5cb9eb2cdf4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:24.546035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:24.547000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 320/631] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:24.547882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0cea4-dece-4757-9449-f5cb9eb2cdf4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.569729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3cc43-f486-4235-ad13-1460d37e2cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.570472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3cc43-f486-4235-ad13-1460d37e2cd6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.570750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3cc43-f486-4235-ad13-1460d37e2cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.571022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3cc43-f486-4235-ad13-1460d37e2cd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.581935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3cc43-f486-4235-ad13-1460d37e2cd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:24.583398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3cc43-f486-4235-ad13-1460d37e2cd6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-74a3cc43-f486-4235-ad13-1460d37e2cd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:24.598509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:24.599472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:24.600389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:24.600389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:24.600389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:24.600389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 312/632] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:24.601051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756e7b-715b-4f35-a6bf-44499410a8fe None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.601156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756e7b-715b-4f35-a6bf-44499410a8fe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.601429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2756e7b-715b-4f35-a6bf-44499410a8fe None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.606002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 313/633] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:24.606002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756e7b-715b-4f35-a6bf-44499410a8fe None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.637528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:24.661144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0cea4-dece-4757-9449-f5cb9eb2cdf4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.697085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.697801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.698028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.698298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.704773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:24.706243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:24.709323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2756e7b-715b-4f35-a6bf-44499410a8fe None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:24.717302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:24.718311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 321/634] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:24.719243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.746949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d192d329-e2c1-4e05-bbbb-cd2b54ce408c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.747558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d329-e2c1-4e05-bbbb-cd2b54ce408c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.747829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d329-e2c1-4e05-bbbb-cd2b54ce408c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.748093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d192d329-e2c1-4e05-bbbb-cd2b54ce408c None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.748752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d329-e2c1-4e05-bbbb-cd2b54ce408c None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:24.749048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d329-e2c1-4e05-bbbb-cd2b54ce408c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:24.750453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d192d329-e2c1-4e05-bbbb-cd2b54ce408c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:24.758275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 314/635] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:24.759031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:24.759419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2811-b696-443c-b9f7-862c2d355aca None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.759694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2811-b696-443c-b9f7-862c2d355aca None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.759960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd2811-b696-443c-b9f7-862c2d355aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.778102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-74dd2811-b696-443c-b9f7-862c2d355aca None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:24.779286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-74dd2811-b696-443c-b9f7-862c2d355aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:24.822455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3f4fb-420c-4da8-aa18-b5d60b83722e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.847513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 315/636] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:24.848367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd2811-b696-443c-b9f7-862c2d355aca None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.867370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.867977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.868251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.868516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.869154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:24.869678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:24.870954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:24.872544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:24.890568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 322/637] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:24.890568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:24.954239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd2811-b696-443c-b9f7-862c2d355aca None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:24.991789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03e34d-3b63-4470-ac4b-63a16311b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:24.992239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:24.992446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e34d-3b63-4470-ac4b-63a16311b068 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:24.992701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e34d-3b63-4470-ac4b-63a16311b068 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:24.992996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03e34d-3b63-4470-ac4b-63a16311b068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:24.995684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bf3d4-a238-415b-87bc-ac8dafc4afe1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.003508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03e34d-3b63-4470-ac4b-63a16311b068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1a03e34d-3b63-4470-ac4b-63a16311b068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:25.008301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:25.009282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 316/638] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:25.010205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03e34d-3b63-4470-ac4b-63a16311b068 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.038462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.039068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.039339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.039599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.040532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:25.040648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.042099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.055833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 323/639] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:25.057133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.099126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:25.119521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03e34d-3b63-4470-ac4b-63a16311b068 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.154247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.154806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.155078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.155338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.161189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d2db1-4363-408f-b133-f9c8294d9eed None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.164922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.166400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:25.180340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:25.181398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:25.182331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:25.182331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:25.182331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:25.182331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 317/640] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:25.182574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.196270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.196898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.197172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.197440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.203976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.205406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:25.216431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:25.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 324/641] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:25.218610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.238852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:25.282704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38c784-9a26-4621-9328-c34cef2ce5e2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.315387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ac417-1f61-4c4b-8466-ca5d8b75f1cc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.316235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.316844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.317117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.317386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.318078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:25.318379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.319850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.321190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:25.329002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 318/642] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:25.329816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.348125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.348723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.348995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.349260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.350003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=fda0f612b2ec42b2beac9af0b49ccff0) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:25.350329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.351773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.357393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 325/643] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/role_assignments?user.id=fda0f612b2ec42b2beac9af0b49ccff0&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:25.358031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.442202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78625628-383c-4a0f-aa7e-dfd6c2a49405 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.460464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:25.478752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81d793-1723-4d22-971d-c09975d40168 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.480303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd3a7-66a7-4e16-8fc2-307ca03f9012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.480950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd3a7-66a7-4e16-8fc2-307ca03f9012 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.481226 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd3a7-66a7-4e16-8fc2-307ca03f9012 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.481493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecd3a7-66a7-4e16-8fc2-307ca03f9012 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.493211 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecd3a7-66a7-4e16-8fc2-307ca03f9012 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f4ecd3a7-66a7-4e16-8fc2-307ca03f9012 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:25.498152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:25.499151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 319/644] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:25.503081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd3a7-66a7-4e16-8fc2-307ca03f9012 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.520806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.521875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.522712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.523128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.523928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:25.524396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.526484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.541064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 326/645] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:25.542254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.571463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:25.629198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecd3a7-66a7-4e16-8fc2-307ca03f9012 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.652862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3407858-56e0-4b7b-beb9-3919f0259f2c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.667287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.667892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.668562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.668562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.669131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:25.669467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.671054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.684451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 320/646] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:25.686203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.690469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.691099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.691375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.691646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.702336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.703715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.706592 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:25.719066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:25.720076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:25.720963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:25.720963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:25.720963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:25.720963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 327/647] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:25.720963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.803505 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24afe34-78f4-4537-92fa-b1310a526a7f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.821461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:25.826185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36123fc6-0994-4759-b56d-f83304a7a7c1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:25.841310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.842341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.842799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.843295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.844133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:25.844633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.846386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.859962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:25.859962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:25.860231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:25.860488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:25.860920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 321/648] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:25.861968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.868060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:25.869496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:25.880681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:25.881668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 328/649] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:25.883215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:25.947361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:25.974471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1403c-03f6-4863-af25-83fc61a28b87 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.009872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121c80e-0660-4d36-91ea-588a13241fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.010192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40989a-5a56-47e1-9c53-605610581c51 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.010535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121c80e-0660-4d36-91ea-588a13241fdf None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.010811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121c80e-0660-4d36-91ea-588a13241fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.011081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121c80e-0660-4d36-91ea-588a13241fdf None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/004e85a47ddd40f89d65bc5ffa817dc6/roles/92f1f6b31904491bb73824b634599912` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.027542 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121c80e-0660-4d36-91ea-588a13241fdf None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=004e85a47ddd40f89d65bc5ffa817dc6, role_id=92f1f6b31904491bb73824b634599912)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.028988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121c80e-0660-4d36-91ea-588a13241fdf None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.042867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 322/650] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:24:25 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/004e85a47ddd40f89d65bc5ffa817dc6/roles/92f1f6b31904491bb73824b634599912 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:24:26.043772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121c80e-0660-4d36-91ea-588a13241fdf None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.062317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.063299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.063884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.064209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.064893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:26.065241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.066873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.081865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 329/651] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:26.083024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.086743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:26.175601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121c80e-0660-4d36-91ea-588a13241fdf None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.212988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.213593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.213914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.214184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.215992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620d75d-76cb-4ae7-b57a-333eb02c1bb6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.225952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.227372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.238684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:26.244493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:26.245502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:26.246479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:26.246479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:26.246479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:26.246479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 323/652] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:26.247185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.262428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.263995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.264916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.265508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.266582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:26.267173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.268893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.296004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 330/653] 10.222.0.48 () {56 vars in 1137 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:26.297023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.351212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:26.378318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6873b-07a5-4a15-b4db-044f0b727235 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.421986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.423620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.424122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.424786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.431491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60704fc-c2da-4dd4-b854-186c0dc9e290 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.436279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.438024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:26.452662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:26.453704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 03:24:26.454731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:26.461054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 324/654] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:26.461054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.478064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.479016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.479649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.480407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.481277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:26.481830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.483921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.502911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 331/655] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:26.502911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.541629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:26.583309 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e8d66-0f78-4faa-bc26-96a817553670 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.616925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22457298-1501-4cdc-9e85-b01f562f63d6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.626133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85cfe-4652-47ca-8df6-e99c46fbca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.627402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85cfe-4652-47ca-8df6-e99c46fbca6a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.628207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85cfe-4652-47ca-8df6-e99c46fbca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.628688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d85cfe-4652-47ca-8df6-e99c46fbca6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.643260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:26.655580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.656431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.656852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.657372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.658333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:26.658813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.660533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.681490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 332/656] 10.222.0.48 () {56 vars in 1139 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:26.682666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.718614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d85cfe-4652-47ca-8df6-e99c46fbca6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.720455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d85cfe-4652-47ca-8df6-e99c46fbca6a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.786109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:26.797413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19fb44-f81d-4a8a-b4f0-8c7282f3fc72 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:26.851523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:26.852498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:26.852961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:26.853406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:26.864347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:26.866764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:26.874251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 325/657] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:26.875355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85cfe-4652-47ca-8df6-e99c46fbca6a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:26.895744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:26.896770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 03:24:26.897877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:26.901131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 333/658] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:26.903259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:26.945070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:27.036614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d85cfe-4652-47ca-8df6-e99c46fbca6a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:27.067101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282477a2-dec9-4b6c-a4b8-cb75bcfec2d4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:27.072010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce76857-de19-4083-bdd0-9dc72eaf0ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:27.072882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce76857-de19-4083-bdd0-9dc72eaf0ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.073390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce76857-de19-4083-bdd0-9dc72eaf0ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.073890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce76857-de19-4083-bdd0-9dc72eaf0ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.116282 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f24a3-8092-4248-924a-874d271f609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:27.118449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f24a3-8092-4248-924a-874d271f609d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.118958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f24a3-8092-4248-924a-874d271f609d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.121520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f24a3-8092-4248-924a-874d271f609d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.141947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f24a3-8092-4248-924a-874d271f609d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:27.143741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f24a3-8092-4248-924a-874d271f609d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-310f24a3-8092-4248-924a-874d271f609d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:27.170181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:27.171221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:27.172125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:27.172125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:27.172125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:27.173746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce76857-de19-4083-bdd0-9dc72eaf0ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:27.178834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce76857-de19-4083-bdd0-9dc72eaf0ff9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:27.179586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 334/659] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:27.180715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f24a3-8092-4248-924a-874d271f609d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:27.186784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:27.283079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:27.318899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f24a3-8092-4248-924a-874d271f609d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:27.388785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:27.390695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.392436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.394136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.395084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:27.395846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:27.398162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:27.405024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 326/660] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:27.406580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce76857-de19-4083-bdd0-9dc72eaf0ff9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:27.431812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 335/661] 10.222.0.48 () {56 vars in 1137 bytes} [Sat Sep 17 03:24:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:27.433477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:27.508182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:27.554032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce76857-de19-4083-bdd0-9dc72eaf0ff9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:27.563630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01bfb-8f38-4b53-ba04-61cfc71b5aa1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:27.599196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:27.600816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.601302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.601797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.603237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:27.604015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:27.604395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:27.605023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.605315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.605582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.606893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:27.617408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:27.618384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:27.618914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:27.623368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 327/662] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:27.624676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:27.643366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:27.644399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:27.645314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:27.645314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:27.645314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:27.645314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 336/663] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:27.646093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:27.740052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eed472-94cb-47ce-b5d1-0e52c80344e7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:27.754931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d93a224-a730-4198-99f2-9436afb0a529 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:27.771607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:27.777207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0ad35-4a1e-4f93-b204-8bc0b9d18ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:27.777890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0ad35-4a1e-4f93-b204-8bc0b9d18ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.778170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0ad35-4a1e-4f93-b204-8bc0b9d18ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.778442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0ad35-4a1e-4f93-b204-8bc0b9d18ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.793531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe012e90-e211-4850-9ce3-aec25d3027cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:27.794338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe012e90-e211-4850-9ce3-aec25d3027cc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.794594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe012e90-e211-4850-9ce3-aec25d3027cc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.794864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe012e90-e211-4850-9ce3-aec25d3027cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.801901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe012e90-e211-4850-9ce3-aec25d3027cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:27.803554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe012e90-e211-4850-9ce3-aec25d3027cc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-fe012e90-e211-4850-9ce3-aec25d3027cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:27.815279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:27.816190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 337/664] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27aa68-3ddf-4471-8103-49d03555a3d1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.822540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27aa68-3ddf-4471-8103-49d03555a3d1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.823157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27aa68-3ddf-4471-8103-49d03555a3d1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.823157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 338/665] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:27.823157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27aa68-3ddf-4471-8103-49d03555a3d1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:27.850951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:27.853052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0ad35-4a1e-4f93-b204-8bc0b9d18ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:27.854567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0ad35-4a1e-4f93-b204-8bc0b9d18ec6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:27.932110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27aa68-3ddf-4471-8103-49d03555a3d1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:27.967676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 328/666] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:27.968829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0ad35-4a1e-4f93-b204-8bc0b9d18ec6 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:27.976193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578176-fa59-4076-b0a2-79c7e3bf053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:27.976893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578176-fa59-4076-b0a2-79c7e3bf053c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.977242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578176-fa59-4076-b0a2-79c7e3bf053c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.977586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578176-fa59-4076-b0a2-79c7e3bf053c None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:27.978338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578176-fa59-4076-b0a2-79c7e3bf053c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:27.978710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578176-fa59-4076-b0a2-79c7e3bf053c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:27.980171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578176-fa59-4076-b0a2-79c7e3bf053c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:27.993668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 339/667] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:27.994903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be6ac-8ae8-412c-a2b5-ac36e5f6e406 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:27.995188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be6ac-8ae8-412c-a2b5-ac36e5f6e406 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:27.995457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9be6ac-8ae8-412c-a2b5-ac36e5f6e406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.013853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2f9be6ac-8ae8-412c-a2b5-ac36e5f6e406 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:28.015048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2f9be6ac-8ae8-412c-a2b5-ac36e5f6e406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:28.041719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:28.083961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 340/668] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:28.084968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9be6ac-8ae8-412c-a2b5-ac36e5f6e406 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.096657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:28.099933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0ad35-4a1e-4f93-b204-8bc0b9d18ec6 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.140311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.141181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.141312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.141719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.142581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:28.142953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.144522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.162169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 329/669] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:28.163314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.204048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9be6ac-8ae8-412c-a2b5-ac36e5f6e406 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.239161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.239939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.240230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.240495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.250813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.252254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:28.267142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:28.268113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:28.269067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:28.269067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:28.269067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:28.269067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 341/670] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:28.269581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.285140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccabfa-cfc0-4ae1-a39a-fd869dc4d819 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.289362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:28.321050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67521df-c643-47e6-a2bc-9be22d805fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.321684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67521df-c643-47e6-a2bc-9be22d805fba None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.321990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67521df-c643-47e6-a2bc-9be22d805fba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.322259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67521df-c643-47e6-a2bc-9be22d805fba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.328803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67521df-c643-47e6-a2bc-9be22d805fba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.330762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67521df-c643-47e6-a2bc-9be22d805fba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e67521df-c643-47e6-a2bc-9be22d805fba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:28.341738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:28.342656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:28.343544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 330/671] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:28.344036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e38fc5-9ea9-4c5b-8e3b-99efa6954351 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.344592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e38fc5-9ea9-4c5b-8e3b-99efa6954351 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.344592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e38fc5-9ea9-4c5b-8e3b-99efa6954351 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.349981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 331/672] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:28.349981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e38fc5-9ea9-4c5b-8e3b-99efa6954351 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.369969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:28.383011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7bfbdf-8417-460f-a60d-1f8732bd4a66 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.415913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.416453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.416725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.416988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.417706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=c46c91e383f44555b753b6500c9cdc44) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:28.418037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.419452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.425360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 342/673] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/role_assignments?user.id=c46c91e383f44555b753b6500c9cdc44&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:28.426175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.454246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e38fc5-9ea9-4c5b-8e3b-99efa6954351 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.495100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5566d-a016-4b91-89c8-89e79d28210e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.495820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5566d-a016-4b91-89c8-89e79d28210e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.496103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5566d-a016-4b91-89c8-89e79d28210e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.496376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5566d-a016-4b91-89c8-89e79d28210e None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.497026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5566d-a016-4b91-89c8-89e79d28210e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:28.497350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5566d-a016-4b91-89c8-89e79d28210e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.498818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5566d-a016-4b91-89c8-89e79d28210e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.512406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 332/674] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:28.513792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5dbf-f0e5-4403-9f49-c5dc82a7fc13 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.514069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5dbf-f0e5-4403-9f49-c5dc82a7fc13 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.514337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fec5dbf-f0e5-4403-9f49-c5dc82a7fc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.524708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:28.533573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1fec5dbf-f0e5-4403-9f49-c5dc82a7fc13 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:28.534925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1fec5dbf-f0e5-4403-9f49-c5dc82a7fc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:28.546511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82361c-2de2-4d9c-ad61-b34ca49117fa None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.585003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.585626 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.585937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.586213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.586920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:28.587224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.588704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.604597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 343/675] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:28.606033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.614817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 333/676] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:28.615765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5dbf-f0e5-4403-9f49-c5dc82a7fc13 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.629161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:28.739669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081bd24-0610-4ea7-9b86-4657920b4b24 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.742835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fec5dbf-f0e5-4403-9f49-c5dc82a7fc13 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.776195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059b94-8ba3-46b6-960c-fcc0199add84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.776932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059b94-8ba3-46b6-960c-fcc0199add84 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.777201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059b94-8ba3-46b6-960c-fcc0199add84 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.777470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c059b94-8ba3-46b6-960c-fcc0199add84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.782275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.783139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.783607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.784080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.785374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:28.788773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c059b94-8ba3-46b6-960c-fcc0199add84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9c059b94-8ba3-46b6-960c-fcc0199add84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:28.793772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:28.795152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:28.796023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:28.797594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.799469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.803470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 344/677] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:28.804418 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059b94-8ba3-46b6-960c-fcc0199add84 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:28.814380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:28.815302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:28.816221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:28.816221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:28.816221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:28.816221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:28.816221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:28.816221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:28.816221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:28.816221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:28.818664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 334/678] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:28.824184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.896495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:28.911329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c059b94-8ba3-46b6-960c-fcc0199add84 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.929254 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1acdb3e-80c7-47bf-af25-b547bc37b03b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:28.948374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.948969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.949243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.949535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.950290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=18061b868be44122a849e2e239b56f60) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:28.950590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.952033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.958324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 345/679] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/role_assignments?user.id=18061b868be44122a849e2e239b56f60&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:28.959151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:28.976538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:28.977563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:28.978125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:28.978621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:28.979560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:28.980103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:28.983606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:28.995220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 335/680] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:28.996456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:29.054856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:29.104852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69615fbe-b607-4682-a338-5111a616eea4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:29.137205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5325a8-b8c5-4b39-89bc-b857d1a49a87 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:29.152926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:29.153571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:29.153897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:29.154533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:29.155506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:29.155846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:29.157256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:29.171403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 346/681] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:29.172287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:29.174156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:29.180251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22f66-8033-4c30-a2a8-b6195d4549a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:29.181809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f66-8033-4c30-a2a8-b6195d4549a0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:29.182142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f66-8033-4c30-a2a8-b6195d4549a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:29.182476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac22f66-8033-4c30-a2a8-b6195d4549a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:29.194735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac22f66-8033-4c30-a2a8-b6195d4549a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6ac22f66-8033-4c30-a2a8-b6195d4549a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:29.200488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:29.201593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:29.202669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 336/682] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:29.203501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22f66-8033-4c30-a2a8-b6195d4549a0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:29.296065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639e2b6-4630-45f8-8d9f-b1a29419c02f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:29.316277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac22f66-8033-4c30-a2a8-b6195d4549a0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:29.322417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:29.334525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:29.335261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:29.335604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:29.335938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:29.347202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:29.348890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:29.354682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:29.355328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:29.355607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:29.355879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:29.356603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=0cd4b1beb0b149ceba9940a0631f23b0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:29.356907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:29.358491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:29.365224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 337/683] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:29 2022] GET /identity/v3/role_assignments?user.id=0cd4b1beb0b149ceba9940a0631f23b0&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:29.365516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:29.366714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:29.368062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:29.368062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:29.368062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:29.368392 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:29.369803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 347/684] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:29.383225 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:29.511599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:29.589697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7da071-34eb-4fc7-b227-83bb67857a1e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:29.593368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b65d-0e1c-44aa-9c7c-ce171fdd173c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:29.640068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:29.640680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:29.640955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:29.641222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:29.641903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:29.642204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:29.643574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:29.646680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:29.647582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:29.648061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:29.648529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:29.649385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:29.649935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:29.651629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:29.656967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 348/685] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:29.663650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 338/686] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:29.664840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:29.669624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:29.718192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:29.787120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d91e81-a46f-4fe3-a4d1-ca40c2029932 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:29.791673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bcf03-8b3e-4d89-b35b-6af388bafbe0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:29.835317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:29.862067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:29.862928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:29.863348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:29.863755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:29.871232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:29.871883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:29.872155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:29.872421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:29.886482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:29.888321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:29.894208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:29.895676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:29.910629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:29.911655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:29.912620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 349/687] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:24:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:29.925621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:29.927804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:29.928958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:29.928958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:29.928958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:29.929182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:29.929279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 339/688] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:29.932756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:30.066645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8fca0-5862-4b29-adbe-87d560e234f0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:30.070061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:30.111283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:30.111900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.112238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.112584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.113818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:30.114334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:30.116824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:30.142176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 350/689] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:24:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:30.151441 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:30.161832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62ec3e-8db9-49e1-b9d3-368551c41064 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:30.238310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:30.238946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.239229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.239501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.240157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:30.240462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:30.241918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:30.258256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d98dd-2753-423b-a3e2-771a58c1a6b2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:30.270997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 340/690] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:30.278775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:30.302444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce46c8-2ae7-43fe-9786-6ade131cddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:30.303058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce46c8-2ae7-43fe-9786-6ade131cddaf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.303335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce46c8-2ae7-43fe-9786-6ade131cddaf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.303641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce46c8-2ae7-43fe-9786-6ade131cddaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.341059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:30.362119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:30.405445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce46c8-2ae7-43fe-9786-6ade131cddaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:30.406961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce46c8-2ae7-43fe-9786-6ade131cddaf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:30.508077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 351/691] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:30.511710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc393e-c271-4216-a5fd-ba5ac10f02b8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:30.513883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce46c8-2ae7-43fe-9786-6ade131cddaf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:30.590130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:30.611068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:30.611727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.612012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.612283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.613960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce46c8-2ae7-43fe-9786-6ade131cddaf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:30.629153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:30.630746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:30.652769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:30.653423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.653701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.654011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:30.663965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:30.665009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:30.666014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:30.667047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:30.668316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:30.673366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 341/692] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:30.674678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:30.696555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:30.697576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:30.698535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:30.698535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:30.698535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:30.699966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 352/693] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:30.705525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:30.818107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:30.827047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e267913-4b58-410e-a4a3-48da84f8df63 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:30.852770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f4dfc-fffa-4382-b2cb-11e8e250d6b8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:30.861314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:30.861548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61914169-1e50-438d-b529-1529a57550f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:30.862382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61914169-1e50-438d-b529-1529a57550f3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.862514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61914169-1e50-438d-b529-1529a57550f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.862725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61914169-1e50-438d-b529-1529a57550f3 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.863452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61914169-1e50-438d-b529-1529a57550f3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:30.863754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61914169-1e50-438d-b529-1529a57550f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:30.865201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61914169-1e50-438d-b529-1529a57550f3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:30.888235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 342/694] 10.222.0.48 () {56 vars in 1135 bytes} [Sat Sep 17 03:24:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:30.889465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc83f2-2664-4f38-8870-aa5f24498e96 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.889769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc83f2-2664-4f38-8870-aa5f24498e96 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.890050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc83f2-2664-4f38-8870-aa5f24498e96 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.891535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 343/695] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:30.892230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc83f2-2664-4f38-8870-aa5f24498e96 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:30.899273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb4609-28d8-4176-a184-62536a107ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:30.899864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb4609-28d8-4176-a184-62536a107ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.902150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb4609-28d8-4176-a184-62536a107ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.902150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb4609-28d8-4176-a184-62536a107ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.902150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb4609-28d8-4176-a184-62536a107ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:30.902150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb4609-28d8-4176-a184-62536a107ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:30.903093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb4609-28d8-4176-a184-62536a107ab9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:30.916986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 353/696] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:30.918548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ab9bd-7850-4aa0-b6c7-eea8175f5efc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:30.918833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ab9bd-7850-4aa0-b6c7-eea8175f5efc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:30.919099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ab9bd-7850-4aa0-b6c7-eea8175f5efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:30.939788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b85ab9bd-7850-4aa0-b6c7-eea8175f5efc None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:30.941257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b85ab9bd-7850-4aa0-b6c7-eea8175f5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:31.006995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc83f2-2664-4f38-8870-aa5f24498e96 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:31.022440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 354/697] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:31.023436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ab9bd-7850-4aa0-b6c7-eea8175f5efc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:31.051814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95524d7-d969-48c7-8ab1-017caef37377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:31.052541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95524d7-d969-48c7-8ab1-017caef37377 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.053124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95524d7-d969-48c7-8ab1-017caef37377 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.053463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95524d7-d969-48c7-8ab1-017caef37377 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.073529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:31.130158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:31.137349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ab9bd-7850-4aa0-b6c7-eea8175f5efc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:31.159093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95524d7-d969-48c7-8ab1-017caef37377 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:31.160664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95524d7-d969-48c7-8ab1-017caef37377 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:31.175404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:31.176177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.176459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.176731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.184057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:31.185597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:31.198757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:31.199735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:31.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 355/698] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:31.205371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:31.270703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 344/699] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 03:24:31.278763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95524d7-d969-48c7-8ab1-017caef37377 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:31.350942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec7a26-de88-49f6-a30f-f8e178365536 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:31.359000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:31.416026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:31.417052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.417525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.417982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.418860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:31.419308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:31.420934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:31.423155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95524d7-d969-48c7-8ab1-017caef37377 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:31.434534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 356/700] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:31.435735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:31.458957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:31.467919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:31.468562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.468834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.469115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.482667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:31.484145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:31.503407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:31.504461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:31.505591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:31.505591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:31.505591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:31.505591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 345/701] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:31.506045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:31.556336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0ade2c-cb0b-4de4-8911-698ebb1deaa5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:31.591868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:31.592869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.593140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.593404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.604963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:31.606471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:31.613629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:31.617630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719258d-d2d6-4501-8008-ae4bd1399d65 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:31.621176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:31.622569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:31.624051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:31.624051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:31.624051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:31.624051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 357/702] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:31.624051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:31.661186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2953cf5-f151-4764-80d1-ce9d7b015f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:31.662086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953cf5-f151-4764-80d1-ce9d7b015f5d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.662507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953cf5-f151-4764-80d1-ce9d7b015f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.662997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2953cf5-f151-4764-80d1-ce9d7b015f5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.663876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2953cf5-f151-4764-80d1-ce9d7b015f5d None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=fda0f612b2ec42b2beac9af0b49ccff0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:31.664329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2953cf5-f151-4764-80d1-ce9d7b015f5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:31.666072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2953cf5-f151-4764-80d1-ce9d7b015f5d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:31.672389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 346/703] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:31 2022] GET /identity/v3/role_assignments?user.id=fda0f612b2ec42b2beac9af0b49ccff0&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:31.673962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b14fc-fa73-4cc0-91aa-5e931e5bfb04 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.674238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b14fc-fa73-4cc0-91aa-5e931e5bfb04 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.674529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b14fc-fa73-4cc0-91aa-5e931e5bfb04 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.677797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 347/704] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:31.677797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b14fc-fa73-4cc0-91aa-5e931e5bfb04 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:31.705135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:31.743234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d375e8-acb0-44bb-9e07-cbec6d61d47e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:31.780174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e8e0b-f1f5-4f3f-b8aa-91527fb5b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:31.780794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8e0b-f1f5-4f3f-b8aa-91527fb5b1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.781060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8e0b-f1f5-4f3f-b8aa-91527fb5b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.781326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e8e0b-f1f5-4f3f-b8aa-91527fb5b1d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.782014 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e8e0b-f1f5-4f3f-b8aa-91527fb5b1d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:31.782323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e8e0b-f1f5-4f3f-b8aa-91527fb5b1d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:31.783698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e8e0b-f1f5-4f3f-b8aa-91527fb5b1d7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:31.796741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b14fc-fa73-4cc0-91aa-5e931e5bfb04 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:31.797110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 358/705] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:31.798504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1949f1-1878-4249-9c6d-12a835e7b9d6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.798785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1949f1-1878-4249-9c6d-12a835e7b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.799055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1949f1-1878-4249-9c6d-12a835e7b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.818260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3d1949f1-1878-4249-9c6d-12a835e7b9d6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:31.819578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3d1949f1-1878-4249-9c6d-12a835e7b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:31.849676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:31.850657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:31.850936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:31.851202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:31.852093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:31.852391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:31.854517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:31.870053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 348/706] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:31.870945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:31.902069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:31.908456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 359/707] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:31.909106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1949f1-1878-4249-9c6d-12a835e7b9d6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:32.037335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd143e-2029-4f2d-b0ff-4db125fc3086 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:32.041679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:32.109485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:32.110173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.110440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.110703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.124086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:32.125545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:32.128586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1949f1-1878-4249-9c6d-12a835e7b9d6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:32.150877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:32.151843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:32.152754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 349/708] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:32.157716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:32.178964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1511f6-fdc7-4f77-a997-20903f99c13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:32.179936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1511f6-fdc7-4f77-a997-20903f99c13b None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.180383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1511f6-fdc7-4f77-a997-20903f99c13b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.180815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1511f6-fdc7-4f77-a997-20903f99c13b None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.181628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1511f6-fdc7-4f77-a997-20903f99c13b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:32.183934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1511f6-fdc7-4f77-a997-20903f99c13b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:32.222923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 360/709] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:24:31 2022] POST /identity/v3/users => generated 254 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:32.224047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1511f6-fdc7-4f77-a997-20903f99c13b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:32.286839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:32.309969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a7e4f0-feb0-445c-9cb5-92d5f65df94b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:32.353118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e63e47-b7a4-45b7-ae68-142002a71730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:32.353342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1511f6-fdc7-4f77-a997-20903f99c13b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:32.354238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63e47-b7a4-45b7-ae68-142002a71730 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.354686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63e47-b7a4-45b7-ae68-142002a71730 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.355386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e63e47-b7a4-45b7-ae68-142002a71730 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.357330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e63e47-b7a4-45b7-ae68-142002a71730 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:32.357868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e63e47-b7a4-45b7-ae68-142002a71730 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:32.359528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e63e47-b7a4-45b7-ae68-142002a71730 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:32.370029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:32.378702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 350/710] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:32.382158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25f57-8746-47bc-b639-238d2c97c7b3 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.382919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25f57-8746-47bc-b639-238d2c97c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.383430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b25f57-8746-47bc-b639-238d2c97c7b3 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.385310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 351/711] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:32.386338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b25f57-8746-47bc-b639-238d2c97c7b3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:32.403317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12be018-2ec7-44f7-98e7-5244a641a652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:32.404149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12be018-2ec7-44f7-98e7-5244a641a652 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.404529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12be018-2ec7-44f7-98e7-5244a641a652 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.404836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12be018-2ec7-44f7-98e7-5244a641a652 None admin] PATH_INFO: `/v3/services/network` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.405535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12be018-2ec7-44f7-98e7-5244a641a652 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:32.407174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12be018-2ec7-44f7-98e7-5244a641a652 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b12be018-2ec7-44f7-98e7-5244a641a652 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:32.419749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:32.420860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:32.421724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 361/712] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:32 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:32.423307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8be34-c539-4a40-9cf2-879fcb8ee175 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.423661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8be34-c539-4a40-9cf2-879fcb8ee175 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.424002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8be34-c539-4a40-9cf2-879fcb8ee175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.444953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-edc8be34-c539-4a40-9cf2-879fcb8ee175 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:32.447093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-edc8be34-c539-4a40-9cf2-879fcb8ee175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:32.524642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b25f57-8746-47bc-b639-238d2c97c7b3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:32.532407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 362/713] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:32.534073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8be34-c539-4a40-9cf2-879fcb8ee175 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:32.563405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:32.563947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.564226 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.564499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.565222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=004e85a47ddd40f89d65bc5ffa817dc6) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:32.565531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:32.567015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:32.573985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 352/714] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:32 2022] GET /identity/v3/role_assignments?user.id=004e85a47ddd40f89d65bc5ffa817dc6&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:32.646193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8be34-c539-4a40-9cf2-879fcb8ee175 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:32.657291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:32.684655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:32.685584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.686027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.686439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.687228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] RBAC: Adding query filter params (name=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:32.687699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:32.689295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:32.695373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 363/715] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:24:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:32.705829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:32.724414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:32.841315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c16bf-1ebf-4609-b5f5-ce0a5a9a9f1d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:32.848856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:32.882082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:32.882704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:32.882982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:32.883252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:32.883887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:32.884184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:32.885814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:32.892468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 353/716] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:24:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:32.974907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532df60-f651-4ab4-860f-a1facb94a850 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:33.016145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:33.016858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:33.017130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:33.017396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:33.018060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:33.019434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:33.029778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:33.030900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:33.031749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 364/717] 10.222.0.48 () {56 vars in 1129 bytes} [Sat Sep 17 03:24:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:33.040386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:33.125717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:33.158088 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e463b2-67b1-453a-9bac-9df325119ad5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:33.193704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5e9db-dc97-4cef-b4aa-4ba0683bc85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:33.194432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e9db-dc97-4cef-b4aa-4ba0683bc85e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:33.194706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e9db-dc97-4cef-b4aa-4ba0683bc85e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:33.194970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e9db-dc97-4cef-b4aa-4ba0683bc85e None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:33.195700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5e9db-dc97-4cef-b4aa-4ba0683bc85e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:33.195968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5e9db-dc97-4cef-b4aa-4ba0683bc85e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:33.197356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5e9db-dc97-4cef-b4aa-4ba0683bc85e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:33.202403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 354/718] 10.222.0.48 () {56 vars in 1124 bytes} [Sat Sep 17 03:24:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:33.208475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:33.252802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:33.320984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c4ac6-6d41-44f8-82e1-8171517706cf None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:33.364462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ee84f-0fa7-4521-8556-bde7099e64d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:33.365089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee84f-0fa7-4521-8556-bde7099e64d0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:33.365362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee84f-0fa7-4521-8556-bde7099e64d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:33.365628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ee84f-0fa7-4521-8556-bde7099e64d0 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:33.366356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee84f-0fa7-4521-8556-bde7099e64d0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:33.366659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee84f-0fa7-4521-8556-bde7099e64d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:33.368046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ee84f-0fa7-4521-8556-bde7099e64d0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:33.381954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 365/719] 10.222.0.48 () {56 vars in 1124 bytes} [Sat Sep 17 03:24:33 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:34.052467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac182a-049b-4cb4-8825-fd1b60ab2cd9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:34.053501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac182a-049b-4cb4-8825-fd1b60ab2cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:34.054034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac182a-049b-4cb4-8825-fd1b60ab2cd9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:34.055797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 355/720] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:34.061355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569789d3-4f46-406b-8f09-af4b98fe54f4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:34.061783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569789d3-4f46-406b-8f09-af4b98fe54f4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:34.061961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569789d3-4f46-406b-8f09-af4b98fe54f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:34.085148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-569789d3-4f46-406b-8f09-af4b98fe54f4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:34.086355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-569789d3-4f46-406b-8f09-af4b98fe54f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:34.184336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 366/721] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:34.592089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac182a-049b-4cb4-8825-fd1b60ab2cd9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:34.721576 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac182a-049b-4cb4-8825-fd1b60ab2cd9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:34.772567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a825-8d6a-4dda-bb37-261b220ab3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:34.773712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a825-8d6a-4dda-bb37-261b220ab3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:34.774303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a825-8d6a-4dda-bb37-261b220ab3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:34.774788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a825-8d6a-4dda-bb37-261b220ab3c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:34.782462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:34.793010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521a825-8d6a-4dda-bb37-261b220ab3c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5521a825-8d6a-4dda-bb37-261b220ab3c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:34.798173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:34.799140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:34.807357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 356/722] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:34.812923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569789d3-4f46-406b-8f09-af4b98fe54f4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:34.850464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:34.883352 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191975-64dc-46ff-98c0-bea482b9e3c6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:34.883676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191975-64dc-46ff-98c0-bea482b9e3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:34.883906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3191975-64dc-46ff-98c0-bea482b9e3c6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:34.885512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 357/723] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:34.891091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69892a-cca0-4725-a875-a38b80205a07 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:34.891629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69892a-cca0-4725-a875-a38b80205a07 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:34.892149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69892a-cca0-4725-a875-a38b80205a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:34.916774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2b69892a-cca0-4725-a875-a38b80205a07 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:34.918022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2b69892a-cca0-4725-a875-a38b80205a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:34.956006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569789d3-4f46-406b-8f09-af4b98fe54f4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:35.030233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:35.030844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:35.031118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:35.031387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:35.032051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:35.032354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:35.034872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:35.048917 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 367/724] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:35.054359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:35.056968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 358/725] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 03:24:35.146309 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:35.154812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fb6f9-ac49-400d-9660-eedf8a641111 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:35.188525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e54863-7443-4a5e-9c6c-07b16c5889b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:35.189153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54863-7443-4a5e-9c6c-07b16c5889b5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:35.189426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54863-7443-4a5e-9c6c-07b16c5889b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:35.189695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e54863-7443-4a5e-9c6c-07b16c5889b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:35.200106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e54863-7443-4a5e-9c6c-07b16c5889b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:35.201556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e54863-7443-4a5e-9c6c-07b16c5889b5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-28e54863-7443-4a5e-9c6c-07b16c5889b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:35.216487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:35.217493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:35.218476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:35.218476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:35.218476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:35.218476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 368/726] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:35.226853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69892a-cca0-4725-a875-a38b80205a07 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:35.365147 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69892a-cca0-4725-a875-a38b80205a07 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:35.400604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:35.409870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:35.410673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:35.411138 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:35.411414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:35.412059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:35.412357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:35.413896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:35.435419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fcdc8-92e3-4bbf-959e-07ee987eeb32 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:35.435802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fcdc8-92e3-4bbf-959e-07ee987eeb32 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:35.435968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fcdc8-92e3-4bbf-959e-07ee987eeb32 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:35.437690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 369/727] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:35.459401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714ea7-f7e9-403a-8945-c00531e89b7e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:35.459805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714ea7-f7e9-403a-8945-c00531e89b7e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:35.460083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03714ea7-f7e9-403a-8945-c00531e89b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:35.485867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-03714ea7-f7e9-403a-8945-c00531e89b7e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:35.487099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-03714ea7-f7e9-403a-8945-c00531e89b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:35.559045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 359/728] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:35.559836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 370/729] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 17 03:24:35.562676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:35.564867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03714ea7-f7e9-403a-8945-c00531e89b7e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:35.684666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:35.734248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03714ea7-f7e9-403a-8945-c00531e89b7e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:35.740511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ba108b-42cf-4493-a555-3603a4ae35df None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:35.803446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:35.804096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:35.804375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:35.804647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:35.810701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b14f-2c28-4c71-9efa-c81b0c9652f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:35.811347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b14f-2c28-4c71-9efa-c81b0c9652f3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:35.811624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b14f-2c28-4c71-9efa-c81b0c9652f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:35.811894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0b14f-2c28-4c71-9efa-c81b0c9652f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:35.818956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:35.820489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:35.830458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0b14f-2c28-4c71-9efa-c81b0c9652f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bae0b14f-2c28-4c71-9efa-c81b0c9652f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:35.840000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:35.840962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:35.841849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:35.845892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 360/730] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:35.846873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:35.848943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:35.851344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:35.852584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b14f-2c28-4c71-9efa-c81b0c9652f3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:35.856611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 371/731] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:24:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:35.857472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:35.909671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:35.963346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0b14f-2c28-4c71-9efa-c81b0c9652f3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:35.966711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35584122-ceaf-47f1-bf76-8392c50b7b61 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.003786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.004404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.004682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.004950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.005605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:36.005939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.007353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.008176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b315c6-1e25-476f-ab6e-64f95e1c4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.008776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b315c6-1e25-476f-ab6e-64f95e1c4dbc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.009046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b315c6-1e25-476f-ab6e-64f95e1c4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.009314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b315c6-1e25-476f-ab6e-64f95e1c4dbc None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.010062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b315c6-1e25-476f-ab6e-64f95e1c4dbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:36.010362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b315c6-1e25-476f-ab6e-64f95e1c4dbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.011754 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b315c6-1e25-476f-ab6e-64f95e1c4dbc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.013706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:36.017259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 361/732] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:36.018601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.041314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 372/733] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:24:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:36.041314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b247a-8d0f-4a17-b36f-52b083c50443 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.041314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b247a-8d0f-4a17-b36f-52b083c50443 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.041314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b247a-8d0f-4a17-b36f-52b083c50443 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.041314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 373/734] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:36.041314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b247a-8d0f-4a17-b36f-52b083c50443 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.134095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829da27-a4a9-4f04-8a2d-65606542ed1c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.146653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:36.153165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b247a-8d0f-4a17-b36f-52b083c50443 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.175464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea17f51-208b-47a2-99d5-ff69b01721b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.176076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea17f51-208b-47a2-99d5-ff69b01721b9 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.176376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea17f51-208b-47a2-99d5-ff69b01721b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.176642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea17f51-208b-47a2-99d5-ff69b01721b9 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.177266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea17f51-208b-47a2-99d5-ff69b01721b9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.178769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea17f51-208b-47a2-99d5-ff69b01721b9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.190790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9071bbc-2d24-4e68-9222-9b007bfbc0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.191742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9071bbc-2d24-4e68-9222-9b007bfbc0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.192145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9071bbc-2d24-4e68-9222-9b007bfbc0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.192534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9071bbc-2d24-4e68-9222-9b007bfbc0c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.197803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 362/735] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:24:36 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:36.197803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea17f51-208b-47a2-99d5-ff69b01721b9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.203534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9071bbc-2d24-4e68-9222-9b007bfbc0c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.205031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9071bbc-2d24-4e68-9222-9b007bfbc0c0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d9071bbc-2d24-4e68-9222-9b007bfbc0c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:36.225131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:36.226774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:36.227809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:36.227809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:36.227809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:36.229908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 374/736] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:36.231694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0cba-417a-4eb5-9d6b-8f9bdb796967 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.233297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0cba-417a-4eb5-9d6b-8f9bdb796967 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.233443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f0cba-417a-4eb5-9d6b-8f9bdb796967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.254609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ac9f0cba-417a-4eb5-9d6b-8f9bdb796967 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:36.255871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ac9f0cba-417a-4eb5-9d6b-8f9bdb796967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:36.300947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:36.335738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea17f51-208b-47a2-99d5-ff69b01721b9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.346103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 375/737] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:36 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:36.347720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f0cba-417a-4eb5-9d6b-8f9bdb796967 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.373579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbe188-70d1-4d16-9a90-79504f867f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.374308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe188-70d1-4d16-9a90-79504f867f6f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.374667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe188-70d1-4d16-9a90-79504f867f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.374998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbe188-70d1-4d16-9a90-79504f867f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.386568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbe188-70d1-4d16-9a90-79504f867f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.388162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbe188-70d1-4d16-9a90-79504f867f6f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f5fbe188-70d1-4d16-9a90-79504f867f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:36.403487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:36.404484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:36.405423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:36.405423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:36.405423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:36.405423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 363/738] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:36.406127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6d2e-1ce1-4f2d-8a33-304a8da9787a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.406294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6d2e-1ce1-4f2d-8a33-304a8da9787a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.406543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c6d2e-1ce1-4f2d-8a33-304a8da9787a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.407985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 364/739] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:36.412914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c6d2e-1ce1-4f2d-8a33-304a8da9787a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.435132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:36.480549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f0cba-417a-4eb5-9d6b-8f9bdb796967 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.531856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c6d2e-1ce1-4f2d-8a33-304a8da9787a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.536228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aaafff-8e81-4e01-a28f-551a6bf21caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.537483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaafff-8e81-4e01-a28f-551a6bf21caa None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.538228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaafff-8e81-4e01-a28f-551a6bf21caa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.538890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aaafff-8e81-4e01-a28f-551a6bf21caa None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.540805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaafff-8e81-4e01-a28f-551a6bf21caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:36.541576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaafff-8e81-4e01-a28f-551a6bf21caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.544201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aaafff-8e81-4e01-a28f-551a6bf21caa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.562498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 376/740] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:36.563771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b4d5-bb99-453e-a78b-4595326ec33b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.564108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b4d5-bb99-453e-a78b-4595326ec33b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.564383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776b4d5-bb99-453e-a78b-4595326ec33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.570843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.571724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.572194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.572470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.573120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:36.573424 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.574844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.585486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4776b4d5-bb99-453e-a78b-4595326ec33b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:36.586992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4776b4d5-bb99-453e-a78b-4595326ec33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:36.589799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 365/741] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:36.589799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.620322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:36.668588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 377/742] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:36 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 03:24:36.669914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776b4d5-bb99-453e-a78b-4595326ec33b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.676340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:36.703427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241aa913-af0c-4908-bb7b-776f16f6f18d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.738692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.739601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.740065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.740512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.748838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.750620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:36.763215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:36.764233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:36.765208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:36.767790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 366/743] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:36.768905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.788380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776b4d5-bb99-453e-a78b-4595326ec33b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.828960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.829602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.829925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.830197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.838701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:36.840256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:36.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:36.854983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 378/744] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:36.856430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.881947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:36.893792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845396e8-e961-41d2-9277-34e7d52597f3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:36.931422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f6cd7-7f5e-45d3-a8b8-ad9c85a10f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:36.932453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6cd7-7f5e-45d3-a8b8-ad9c85a10f18 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:36.932962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6cd7-7f5e-45d3-a8b8-ad9c85a10f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:36.933428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215f6cd7-7f5e-45d3-a8b8-ad9c85a10f18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:36.936640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:36.946209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215f6cd7-7f5e-45d3-a8b8-ad9c85a10f18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-215f6cd7-7f5e-45d3-a8b8-ad9c85a10f18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:36.951794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:36.952744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:36.953612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 367/745] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:36.954459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f6cd7-7f5e-45d3-a8b8-ad9c85a10f18 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:36.977802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e319f09-fe7c-43d3-b51c-1c24b0d5d255 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:37.015897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:37.016427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:37.016704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:37.016980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:37.017745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:37.018054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:37.019508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:37.039387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 379/746] 10.222.0.48 () {56 vars in 1149 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:37.044013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:37.062938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215f6cd7-7f5e-45d3-a8b8-ad9c85a10f18 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:37.099160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:37.099774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:37.100403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:37.100403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:37.101060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:37.101360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:37.102833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:37.114663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 368/747] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:37.115399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:37.131699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:37.154773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b3445-5325-4911-93bc-8ba669378a94 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:37.174719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:37.191927 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89da2a-1774-477c-8093-b09fa0ce023f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:37.192544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89da2a-1774-477c-8093-b09fa0ce023f None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:37.192821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89da2a-1774-477c-8093-b09fa0ce023f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:37.193092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89da2a-1774-477c-8093-b09fa0ce023f None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:37.193744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89da2a-1774-477c-8093-b09fa0ce023f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:37.195206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89da2a-1774-477c-8093-b09fa0ce023f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:37.221516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 380/748] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:24:37 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:37.221516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89da2a-1774-477c-8093-b09fa0ce023f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:37.230878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1a99-028f-4d73-b2f7-03597552c316 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:37.274793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:37.275690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:37.276152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:37.276617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:37.277477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:37.278013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:37.279623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:37.294403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 369/749] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:37.295718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:37.337447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89da2a-1774-477c-8093-b09fa0ce023f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:37.376523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77331d23-bdf3-4170-9654-8332c8fc86f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:37.377154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331d23-bdf3-4170-9654-8332c8fc86f9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:37.377432 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331d23-bdf3-4170-9654-8332c8fc86f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:37.377705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77331d23-bdf3-4170-9654-8332c8fc86f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:37.389401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:37.408766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43ce4d-adeb-4c80-8205-c911b05a80b2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:37.424442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:37.451889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ed22a-139e-4ee9-a9aa-9d0c621a2cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:37.452832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ed22a-139e-4ee9-a9aa-9d0c621a2cc9 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:37.453255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ed22a-139e-4ee9-a9aa-9d0c621a2cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:37.453529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ed22a-139e-4ee9-a9aa-9d0c621a2cc9 None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/fda0f612b2ec42b2beac9af0b49ccff0/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:37.455516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ed22a-139e-4ee9-a9aa-9d0c621a2cc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=fda0f612b2ec42b2beac9af0b49ccff0, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:37.456960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ed22a-139e-4ee9-a9aa-9d0c621a2cc9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:37.468121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77331d23-bdf3-4170-9654-8332c8fc86f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:37.469653 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77331d23-bdf3-4170-9654-8332c8fc86f9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:37.471917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 370/750] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:24:37 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/fda0f612b2ec42b2beac9af0b49ccff0/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:24:37.473053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ed22a-139e-4ee9-a9aa-9d0c621a2cc9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:37.661419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 381/751] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:24:37.667001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77331d23-bdf3-4170-9654-8332c8fc86f9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:37.669650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ed22a-139e-4ee9-a9aa-9d0c621a2cc9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:37.713988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:37.714630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:37.714909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:37.715182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:37.718585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:37.739800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:37.741601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:37.773281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:37.774349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:37.775263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:37.775263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:37.775263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:37.775263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 371/752] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:37.780200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:37.809003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77331d23-bdf3-4170-9654-8332c8fc86f9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:37.837223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:37.861105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:37.861741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:37.862034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:37.862299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:37.878882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:37.881513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:37.899419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:37.900412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:37.901335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:37.901335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:37.901335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:37.904211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 382/753] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:37.909834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:37.954586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fc474-05b7-484f-9f4e-821dfcd9174a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:38.039505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:38.044718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:38.045350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.045624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.045923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.046575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:38.046876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:38.048258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:38.052157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4df42-af63-46c0-910f-f47499afda51 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:38.071148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 372/754] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:38.076332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:38.098323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:38.099427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.101110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.101596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.102660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:38.103916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:38.105641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:38.131509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 383/755] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:38.139055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:38.245290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:38.270472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c809c88-d876-4b1e-a0c1-35773ca27ead None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:38.306138 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:38.307184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.307652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.308110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] PATH_INFO: `/v3/users/swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.316498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:38.318223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:38.328262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385b9671-0edf-412a-9f0e-f55876ab0da3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:38.331511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:38.332457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:38.333490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:38.336212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 373/756] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:38.343109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:38.384604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:38.385674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.386166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.386625 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.394881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:38.396381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:38.415101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:38.416011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:38.416930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 384/757] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:38.424958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:38.457799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:38.537429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334e4fd-dd13-4841-810d-af117b34f0ff None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:38.576321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:38.577343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.577843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.578303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.579720 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:38.580356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:38.582023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:38.601909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 374/758] 10.222.0.48 () {56 vars in 1135 bytes} [Sat Sep 17 03:24:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:38.607910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:38.615527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:38.650071 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620eb98b-3a4d-482d-8223-9bda83d6c1ed None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:38.688563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3d53e-8226-42be-97fb-b87d10816951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:38.689203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3d53e-8226-42be-97fb-b87d10816951 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.689479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3d53e-8226-42be-97fb-b87d10816951 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.689773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3d53e-8226-42be-97fb-b87d10816951 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.690471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3d53e-8226-42be-97fb-b87d10816951 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:38.690776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3d53e-8226-42be-97fb-b87d10816951 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:38.692825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3d53e-8226-42be-97fb-b87d10816951 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:38.713893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 385/759] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:38.715233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f226-1f11-4090-924f-223a689f1f58 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.715516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f226-1f11-4090-924f-223a689f1f58 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.715789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f226-1f11-4090-924f-223a689f1f58 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.717024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 386/760] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:38.717709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f226-1f11-4090-924f-223a689f1f58 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:38.753485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3a1c0c-0e93-4636-a148-a11ac80ce79b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:38.788773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d59d3-afc5-4433-9e62-938ae6289e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:38.789303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d59d3-afc5-4433-9e62-938ae6289e28 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.789578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d59d3-afc5-4433-9e62-938ae6289e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.789886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d59d3-afc5-4433-9e62-938ae6289e28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.810631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:38.854935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f226-1f11-4090-924f-223a689f1f58 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:38.869009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d59d3-afc5-4433-9e62-938ae6289e28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:38.870746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494d59d3-afc5-4433-9e62-938ae6289e28 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:38.880718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:38.896449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d0617-e650-40f4-a4f4-328e149d6b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:38.897123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d0617-e650-40f4-a4f4-328e149d6b13 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.897392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d0617-e650-40f4-a4f4-328e149d6b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.897661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d0617-e650-40f4-a4f4-328e149d6b13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.898744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d0617-e650-40f4-a4f4-328e149d6b13 None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=e5757b587e93429bacdf4a1b7f17d00a) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:38.899093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d0617-e650-40f4-a4f4-328e149d6b13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:38.901086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d0617-e650-40f4-a4f4-328e149d6b13 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:38.913779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 387/761] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:38 2022] GET /identity/v3/role_assignments?user.id=e5757b587e93429bacdf4a1b7f17d00a&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:38.913779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544c158-930c-4581-b73c-16d430fb3f4f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:38.913779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544c158-930c-4581-b73c-16d430fb3f4f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:38.913779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1544c158-930c-4581-b73c-16d430fb3f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:38.944332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1544c158-930c-4581-b73c-16d430fb3f4f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:38.945566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1544c158-930c-4581-b73c-16d430fb3f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:39.050404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 375/762] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:24:39.057776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d59d3-afc5-4433-9e62-938ae6289e28 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:39.088561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 388/763] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:39.161566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d59d3-afc5-4433-9e62-938ae6289e28 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:39.164248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:39.203062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:39.203062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.203062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.203062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.214100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:39.215566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:39.231122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:39.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:39.234202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:39.234202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:39.234202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:39.234202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 376/764] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:39.238184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544c158-930c-4581-b73c-16d430fb3f4f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:39.303655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:39.348368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1544c158-930c-4581-b73c-16d430fb3f4f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:39.386606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:39.387218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.387858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.388126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.388773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:39.389069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:39.390523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:39.402630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 389/765] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:39.408288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:39.512229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717492f-418b-41b9-8ac0-7a2d7a0f1c9c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:39.517034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:39.558234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:39.558797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.559068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.559334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.572123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:39.572123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:39.589845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:39.590830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:39.591746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:39.591746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:39.591746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:39.591746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:39.591746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:39.591746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:39.591746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:39.591746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:39.594355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 377/766] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:39.601847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:39.638137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:39.676361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd164af7-1a01-4274-940f-7ff0e06c4cad None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:39.717875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:39.732462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7b078-62f4-4105-a1cf-331da3a6abf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:39.733981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7b078-62f4-4105-a1cf-331da3a6abf8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.734457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7b078-62f4-4105-a1cf-331da3a6abf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.734934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7b078-62f4-4105-a1cf-331da3a6abf8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.735709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7b078-62f4-4105-a1cf-331da3a6abf8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:39.737265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7b078-62f4-4105-a1cf-331da3a6abf8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:39.741578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab31b5-ef82-4716-ad76-bb24ea0390d7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-29d7b078-62f4-4105-a1cf-331da3a6abf8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:39.747591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:39.748580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:39.749436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:39.752268 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 390/767] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:39 2022] GET /identity/v3/services/network => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:39.753706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c31c-4689-4ee9-b33e-0bb713e32bc1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.754212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c31c-4689-4ee9-b33e-0bb713e32bc1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.754684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9408c31c-4689-4ee9-b33e-0bb713e32bc1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.756078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 391/768] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:39.757535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408c31c-4689-4ee9-b33e-0bb713e32bc1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:39.786172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e268fd5-7f8c-4a30-a2f1-58785925ae92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:39.786809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268fd5-7f8c-4a30-a2f1-58785925ae92 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.787084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268fd5-7f8c-4a30-a2f1-58785925ae92 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.787353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268fd5-7f8c-4a30-a2f1-58785925ae92 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.788106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e268fd5-7f8c-4a30-a2f1-58785925ae92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:39.788415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e268fd5-7f8c-4a30-a2f1-58785925ae92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:39.789958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e268fd5-7f8c-4a30-a2f1-58785925ae92 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:39.803247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 378/769] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:39.804539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5da30-e384-4727-a787-4b37d88b8b49 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.804820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5da30-e384-4727-a787-4b37d88b8b49 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.805091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5da30-e384-4727-a787-4b37d88b8b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.824897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-65b5da30-e384-4727-a787-4b37d88b8b49 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:39.826076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-65b5da30-e384-4727-a787-4b37d88b8b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:39.877808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9408c31c-4689-4ee9-b33e-0bb713e32bc1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:39.906133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 379/770] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:39.907107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5da30-e384-4727-a787-4b37d88b8b49 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:39.924479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:39.924672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d61f24-ed17-4a63-be84-cbc01b72c81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:39.925174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d61f24-ed17-4a63-be84-cbc01b72c81e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.925802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d61f24-ed17-4a63-be84-cbc01b72c81e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.925802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d61f24-ed17-4a63-be84-cbc01b72c81e None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.927457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d61f24-ed17-4a63-be84-cbc01b72c81e None admin] RBAC: Adding query filter params (name=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:39.927457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d61f24-ed17-4a63-be84-cbc01b72c81e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:39.928063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d61f24-ed17-4a63-be84-cbc01b72c81e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:39.939423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 392/771] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:24:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:39.940665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01527fa-2863-4d58-a826-a4ba73effe80 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:39.940941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01527fa-2863-4d58-a826-a4ba73effe80 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:39.941209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01527fa-2863-4d58-a826-a4ba73effe80 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:39.942431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 393/772] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:39.948278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01527fa-2863-4d58-a826-a4ba73effe80 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:40.007932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:40.059489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01527fa-2863-4d58-a826-a4ba73effe80 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:40.063534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5da30-e384-4727-a787-4b37d88b8b49 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:40.096555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874f7e5-c6b5-48eb-98c5-997fd4f90cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:40.097160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f7e5-c6b5-48eb-98c5-997fd4f90cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:40.097439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f7e5-c6b5-48eb-98c5-997fd4f90cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:40.097706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874f7e5-c6b5-48eb-98c5-997fd4f90cf2 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:40.098357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874f7e5-c6b5-48eb-98c5-997fd4f90cf2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:40.098653 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874f7e5-c6b5-48eb-98c5-997fd4f90cf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:40.100019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874f7e5-c6b5-48eb-98c5-997fd4f90cf2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:40.105603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 394/773] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:24:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:40.110373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0222-974d-4e87-9818-de76da2da569 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:40.110373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0222-974d-4e87-9818-de76da2da569 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:40.110373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0222-974d-4e87-9818-de76da2da569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:40.118440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:40.119360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:40.119831 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:40.120330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:40.121794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=004e85a47ddd40f89d65bc5ffa817dc6) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:40.122436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:40.124267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:40.126575 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-65ba0222-974d-4e87-9818-de76da2da569 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:40.128056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-65ba0222-974d-4e87-9818-de76da2da569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:40.138292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 380/774] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:39 2022] GET /identity/v3/role_assignments?user.id=004e85a47ddd40f89d65bc5ffa817dc6&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:40.138918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:40.239837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 395/775] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:40.240797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0222-974d-4e87-9818-de76da2da569 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:40.257085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:40.319765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1749a4-1f7b-4d8b-b3fd-b49f00329a09 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:40.329462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:40.373376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:40.374041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:40.374322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:40.374594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:40.375306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] RBAC: Adding query filter params (interface=public, service_id=7920e22cc5eb446eb60bda5a7e2f1a8b, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:40.375699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:40.377096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:40.387369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 381/776] 10.222.0.48 () {56 vars in 1251 bytes} [Sat Sep 17 03:24:40 2022] GET /identity/v3/endpoints?service_id=7920e22cc5eb446eb60bda5a7e2f1a8b&interface=public®ion_id=RegionOne => generated 194 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:40.394437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:40.421483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0222-974d-4e87-9818-de76da2da569 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:40.496165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:40.496814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:40.497090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:40.497360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:40.497988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:40.499354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:40.517977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:40.520298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:40.522740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 396/777] 10.222.0.48 () {56 vars in 1129 bytes} [Sat Sep 17 03:24:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:40.533464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:40.578635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e523df-879d-499d-ae8a-f2c2cf273307 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:40.627876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baca34b-5ed5-4f48-8f52-14a451325722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:40.628585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca34b-5ed5-4f48-8f52-14a451325722 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:40.629214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca34b-5ed5-4f48-8f52-14a451325722 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:40.629581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baca34b-5ed5-4f48-8f52-14a451325722 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:40.630323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baca34b-5ed5-4f48-8f52-14a451325722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:40.633095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baca34b-5ed5-4f48-8f52-14a451325722 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:40.634378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:40.640754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 382/778] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:24:40 2022] GET /identity/v3/services => generated 772 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:40.642218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baca34b-5ed5-4f48-8f52-14a451325722 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:40.669603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd12b125-ccde-4440-8795-7228157a6d07 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:40.685149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:40.735493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:40.736489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:40.736956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:40.737400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:40.738209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:40.738665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:40.740253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:40.758550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 397/779] 10.222.0.48 () {56 vars in 1124 bytes} [Sat Sep 17 03:24:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:40.765240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:40.771277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baca34b-5ed5-4f48-8f52-14a451325722 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:40.810714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d31bae-6902-4bfe-a356-38582f0de5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:40.811530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d31bae-6902-4bfe-a356-38582f0de5e8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:40.811899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d31bae-6902-4bfe-a356-38582f0de5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:40.812265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d31bae-6902-4bfe-a356-38582f0de5e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:40.825667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d31bae-6902-4bfe-a356-38582f0de5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e1d31bae-6902-4bfe-a356-38582f0de5e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:40.832390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:40.833613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:40.834779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:40.836621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 383/780] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:40.843014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d31bae-6902-4bfe-a356-38582f0de5e8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:40.918167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:40.995114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d31bae-6902-4bfe-a356-38582f0de5e8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:40.996738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7a716-abd6-44dd-9d8f-61945343f0cc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:41.034850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:41.035463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.035741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.036011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.036653 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:41.036953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:41.038567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:41.041471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:41.042642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.043127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.043612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.044468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 398/781] 10.222.0.48 () {56 vars in 1124 bytes} [Sat Sep 17 03:24:40 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:41.044659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:41.045172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:41.046769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:41.054902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:41.063752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 384/782] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:41.071296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:41.104729 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:41.202530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8eefb2-b91e-4f99-9d42-63a7ae8a9a06 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:41.217642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3b85e-e695-448f-ac09-64dd2c99ef33 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:41.245142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:41.272620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:41.273284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.273564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.277812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.294885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:41.295842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.296265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.296677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.297531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] RBAC: Adding query filter params (interface=public, service_id=e0eab8d0d83441f0ac454102ddba245a, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:41.298033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:41.300554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:41.301703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:41.303371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:41.321068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 399/783] 10.222.0.48 () {56 vars in 1251 bytes} [Sat Sep 17 03:24:41 2022] GET /identity/v3/endpoints?service_id=e0eab8d0d83441f0ac454102ddba245a&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:41.333319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:41.334376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:41.335325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:41.335325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:41.335325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:41.337222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 385/784] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:41.342926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:41.344000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:41.448016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881b48a3-9a3d-40fe-8283-5b6ae46faf4c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:41.458146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:41.466512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd14a31-db2b-4002-a8ef-6d9c255ec0a4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:41.484347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49682be-1938-4beb-afcc-bd1f03131e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:41.485218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49682be-1938-4beb-afcc-bd1f03131e44 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.485601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49682be-1938-4beb-afcc-bd1f03131e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.485990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49682be-1938-4beb-afcc-bd1f03131e44 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.486692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49682be-1938-4beb-afcc-bd1f03131e44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:41.488219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49682be-1938-4beb-afcc-bd1f03131e44 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:41.497860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 400/785] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:24:41 2022] GET /identity/v3/services => generated 772 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:41.497860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37ff03-aed4-4174-b28b-4378df991b1a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.497860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37ff03-aed4-4174-b28b-4378df991b1a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.497860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37ff03-aed4-4174-b28b-4378df991b1a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.497860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 401/786] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:41.510337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4fce-5e13-43be-a150-bd2273ea9146 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.510337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4fce-5e13-43be-a150-bd2273ea9146 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.510337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4fce-5e13-43be-a150-bd2273ea9146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.522438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:41.523072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.523347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.523617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.524276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:41.524577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:41.526017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:41.534889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0e6a4fce-5e13-43be-a150-bd2273ea9146 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:41.536520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0e6a4fce-5e13-43be-a150-bd2273ea9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:41.555824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 386/787] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:41.567435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:41.621935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 402/788] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:24:41.667912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:41.750503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f56c656-e24c-4951-8728-623e881eb6fc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:41.784968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:41.785607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.785912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.786183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.793546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:41.795105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:41.806908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:41.807884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:41.808854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 387/789] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:24:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:41.814023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4fce-5e13-43be-a150-bd2273ea9146 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:41.914415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:41.921718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4fce-5e13-43be-a150-bd2273ea9146 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:41.955827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:41.956452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:41.956727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:41.956998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:41.957727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:41.958060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:41.959569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:41.963448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:41.978815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 403/790] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:24:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:41.984824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:42.089300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530fb33e-bfa3-4a08-9fbd-1704d0743c7c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:42.124861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c839bc-e425-4ae9-898f-25901e925ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:42.125475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c839bc-e425-4ae9-898f-25901e925ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:42.125772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c839bc-e425-4ae9-898f-25901e925ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:42.126049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c839bc-e425-4ae9-898f-25901e925ae7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:42.158152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:42.195133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:42.211330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfa3f2-8fa6-45fb-aef5-930b256fadc2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:42.215541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c839bc-e425-4ae9-898f-25901e925ae7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:42.217035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c839bc-e425-4ae9-898f-25901e925ae7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:42.280304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439209df-9e5c-4c5f-bfc3-78fb4cb26a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:42.280944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439209df-9e5c-4c5f-bfc3-78fb4cb26a4f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:42.281216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439209df-9e5c-4c5f-bfc3-78fb4cb26a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:42.281483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439209df-9e5c-4c5f-bfc3-78fb4cb26a4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:42.308021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439209df-9e5c-4c5f-bfc3-78fb4cb26a4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-439209df-9e5c-4c5f-bfc3-78fb4cb26a4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:42.314108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:42.315104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:42.315966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 388/791] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:42.323387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439209df-9e5c-4c5f-bfc3-78fb4cb26a4f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:42.439988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439209df-9e5c-4c5f-bfc3-78fb4cb26a4f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:42.481685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:42.482319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:42.482592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:42.482864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:42.483512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:42.483805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:42.485170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:42.505134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 389/792] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:42.510956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:42.532118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:42.561160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 404/793] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 03:24:42.567139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c839bc-e425-4ae9-898f-25901e925ae7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:42.673003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:42.691484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229c7129-78c9-47ce-80b5-1b5a5ddab87a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:42.726042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335b6dd-753f-45a7-9f9c-f71bf5ff1bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:42.726747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b6dd-753f-45a7-9f9c-f71bf5ff1bae None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:42.727019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b6dd-753f-45a7-9f9c-f71bf5ff1bae None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:42.727289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335b6dd-753f-45a7-9f9c-f71bf5ff1bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:42.729133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c839bc-e425-4ae9-898f-25901e925ae7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:42.738552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335b6dd-753f-45a7-9f9c-f71bf5ff1bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:42.740121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8335b6dd-753f-45a7-9f9c-f71bf5ff1bae None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8335b6dd-753f-45a7-9f9c-f71bf5ff1bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:42.755423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:42.757671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:42.759829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:42.759829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:42.759829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:42.759829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 390/794] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:42.759829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04883-db50-407f-9011-87a8c3737889 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:42.759829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04883-db50-407f-9011-87a8c3737889 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:42.759829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04883-db50-407f-9011-87a8c3737889 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:42.760714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 391/795] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:42.768233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b5c8-9500-45ea-b05d-81750bc922cc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:42.768512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b5c8-9500-45ea-b05d-81750bc922cc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:42.768781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447b5c8-9500-45ea-b05d-81750bc922cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:42.780299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:42.781065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:42.781408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:42.781745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:42.790982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6447b5c8-9500-45ea-b05d-81750bc922cc None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:42.792408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6447b5c8-9500-45ea-b05d-81750bc922cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:42.792892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:42.794574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:42.810664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:42.811726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:42.812649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:42.812649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:42.812649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:42.814656 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 405/796] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:42.816728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:42.879290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:42.891858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 392/797] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:42.892914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447b5c8-9500-45ea-b05d-81750bc922cc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:42.976052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf231760-43d6-4505-8ca9-fab9d0a433ea None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:42.991209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:43.009580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447b5c8-9500-45ea-b05d-81750bc922cc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.048671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.049297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.049582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.049870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.050655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:43.050956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.052577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.065346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 393/798] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:43.066995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.067621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.067897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.068161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.068892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:43.069191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.070641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.072426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.092021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 406/799] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:43.097913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.190491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:43.249328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8296c-10e9-4d77-be75-650d835576e1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.264628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e16b6-4b26-4f64-a631-2e99c61013e0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.285461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.286125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.286415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.286662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.294040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.295483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.298193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780efc7-a82b-491a-a949-20b16d6879c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.298812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780efc7-a82b-491a-a949-20b16d6879c6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.299085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780efc7-a82b-491a-a949-20b16d6879c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.299348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780efc7-a82b-491a-a949-20b16d6879c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.306807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780efc7-a82b-491a-a949-20b16d6879c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:43.307624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:43.308569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:43.309481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:43.309481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:43.309481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:43.309481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:43.309481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:43.309481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:43.309481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:43.309481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:43.310537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e780efc7-a82b-491a-a949-20b16d6879c6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.310622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 394/800] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:43.310622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-e780efc7-a82b-491a-a949-20b16d6879c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:43.324379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:43.325360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 407/801] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c74dc-8887-4452-9c4c-5af814c9f77f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.331469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c74dc-8887-4452-9c4c-5af814c9f77f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.332349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c74dc-8887-4452-9c4c-5af814c9f77f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.332349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 408/802] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:43.332349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c74dc-8887-4452-9c4c-5af814c9f77f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.361021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:43.422358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9384f912-f5ea-4836-9382-7423844689c3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.438531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c74dc-8887-4452-9c4c-5af814c9f77f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.439562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:43.456950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34df74e-7d31-4f7f-9912-4c63d67615e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.457577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34df74e-7d31-4f7f-9912-4c63d67615e0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.457886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34df74e-7d31-4f7f-9912-4c63d67615e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.458165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34df74e-7d31-4f7f-9912-4c63d67615e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.468413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34df74e-7d31-4f7f-9912-4c63d67615e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:43.473156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b0c68-fc74-4589-9787-912e46e50da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-d34df74e-7d31-4f7f-9912-4c63d67615e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:43.473630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:43.474588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:43.476118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:43.476802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0c68-fc74-4589-9787-912e46e50da7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.476802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0c68-fc74-4589-9787-912e46e50da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.476802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b0c68-fc74-4589-9787-912e46e50da7 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.476802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0c68-fc74-4589-9787-912e46e50da7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:43.477050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 395/803] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:43.477120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0c68-fc74-4589-9787-912e46e50da7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.477189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34df74e-7d31-4f7f-9912-4c63d67615e0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.477259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b0c68-fc74-4589-9787-912e46e50da7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.492411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 409/804] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:43.493599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551d3b4-ed37-4003-ab7d-c7d2d2bf2272 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.493915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551d3b4-ed37-4003-ab7d-c7d2d2bf2272 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.494180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551d3b4-ed37-4003-ab7d-c7d2d2bf2272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.511363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7551d3b4-ed37-4003-ab7d-c7d2d2bf2272 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:43.512810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7551d3b4-ed37-4003-ab7d-c7d2d2bf2272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:43.581154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 410/805] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:43.582147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551d3b4-ed37-4003-ab7d-c7d2d2bf2272 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.597068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34df74e-7d31-4f7f-9912-4c63d67615e0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.602906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:43.639955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.640712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.640988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.641255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.642004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:43.642305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.644173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.666898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 396/806] 10.222.0.48 () {56 vars in 1149 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:43.667821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.701807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551d3b4-ed37-4003-ab7d-c7d2d2bf2272 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.710902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:43.739125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.739872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.740054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.740323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.741023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:43.741354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.742724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.756520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 411/807] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:43.756520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.794030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b7677-7260-452a-bdd3-2cbc01910e3f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.838646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.839255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.839529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.839793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.840512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=fda0f612b2ec42b2beac9af0b49ccff0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:43.840867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.842357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.847500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:43.851055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 397/808] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/role_assignments?user.id=fda0f612b2ec42b2beac9af0b49ccff0&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:43.851858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:43.878524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3385c-9df4-4b38-8c33-99611f2a4e95 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:43.920318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:43.920986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:43.921251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:43.921517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:43.934680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:43.936231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:43.954119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:43.955170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:43.956119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:43.956119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:43.956119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:43.956119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 412/809] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:43.956907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.001422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:44.008539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca0e88-5e62-45cc-a1da-9b59c031f185 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.061841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.062927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.062927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.062927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.075828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.077287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:44.095472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:44.096462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:44.097374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:44.097374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:44.097374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:44.097374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 398/810] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:44.098294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.103780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa87c15-e544-46af-a779-89aedb017df5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.138688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:44.143483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.145130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.145617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.146260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] PATH_INFO: `/v3/services/network` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.147689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.150099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:44.162699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:44.163870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:44.164759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 413/811] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:43 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:44.165580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.213516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b723e-3a85-4fd6-a021-cbbba4f3fc03 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.249287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51e5d7-406e-44aa-a580-8971dcb8db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.249932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e5d7-406e-44aa-a580-8971dcb8db00 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.250311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e5d7-406e-44aa-a580-8971dcb8db00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.250574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51e5d7-406e-44aa-a580-8971dcb8db00 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.251322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51e5d7-406e-44aa-a580-8971dcb8db00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:44.251618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51e5d7-406e-44aa-a580-8971dcb8db00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.252984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51e5d7-406e-44aa-a580-8971dcb8db00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.265989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 399/812] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:44.267305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c07318-7b26-415e-8305-e39f53585859 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.267586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c07318-7b26-415e-8305-e39f53585859 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.267890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c07318-7b26-415e-8305-e39f53585859 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.269226 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 400/813] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:44.269740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c07318-7b26-415e-8305-e39f53585859 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.279719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c65b69-b91a-4262-98fa-bda4e47b3666 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.281920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:44.319167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.319694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.319967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.320527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.321179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:44.321481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.322878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.339178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 414/814] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:44.339178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.383300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c07318-7b26-415e-8305-e39f53585859 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.394005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:44.422677 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b685d3e-dd4d-49c0-b4dd-c9fb6a1555a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.423444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685d3e-dd4d-49c0-b4dd-c9fb6a1555a7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.424078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685d3e-dd4d-49c0-b4dd-c9fb6a1555a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.424352 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b685d3e-dd4d-49c0-b4dd-c9fb6a1555a7 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.425231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b685d3e-dd4d-49c0-b4dd-c9fb6a1555a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:44.425531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b685d3e-dd4d-49c0-b4dd-c9fb6a1555a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.427376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b685d3e-dd4d-49c0-b4dd-c9fb6a1555a7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.437715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 401/815] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:44.437715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f7cf7-94aa-4f86-b549-b485c84dffda None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.437715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f7cf7-94aa-4f86-b549-b485c84dffda None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.437715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f7cf7-94aa-4f86-b549-b485c84dffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.441489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc9922-881c-4175-a0e6-cdfe4dbae5ab None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.458159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4e2f7cf7-94aa-4f86-b549-b485c84dffda None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:44.459394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4e2f7cf7-94aa-4f86-b549-b485c84dffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:44.475317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.476321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.476731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.476871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.483874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.485334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:44.496884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:44.497845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:44.498932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:44.498932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:44.498932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:44.498932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:44.498932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:44.498932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:44.498932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:44.498932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:44.502746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 415/816] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:44.503645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.534968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 402/817] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:44.536064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f7cf7-94aa-4f86-b549-b485c84dffda None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.545196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:44.622670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdee3a2-b843-417a-a465-7ef1c99e59ee None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.638340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:44.667834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.668658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f7cf7-94aa-4f86-b549-b485c84dffda None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.669030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.669515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.670229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.681525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.683710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:44.697162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:44.698423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:44.699613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:44.705509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 416/818] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:44.705509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.723617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.724787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.725782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.726199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.727325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] RBAC: Adding query filter params (type=network) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:44.727767 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.729972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.737252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 403/819] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:44.738210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.814733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234bdd6-79b9-43b3-a75e-e41fac8767fe None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.830373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:44.848887 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.850263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.850977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.851439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.852537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:44.853364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.854989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.873041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 417/820] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:44.873201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df500dbd-a660-44e7-80bd-a66fc3783a65 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:44.873287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.906109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:44.908201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:44.908721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:44.909090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:44.909429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:44.910253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:44.910556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:44.911990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:44.929487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 404/821] 10.222.0.48 () {56 vars in 1135 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:44.930225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:44.984748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ca950-3b75-4ecb-8c58-ec0485aa09c0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.024341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff51a74-ebad-4e15-aee0-5381edf9108e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.024949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff51a74-ebad-4e15-aee0-5381edf9108e None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.025218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff51a74-ebad-4e15-aee0-5381edf9108e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.025485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff51a74-ebad-4e15-aee0-5381edf9108e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.026172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff51a74-ebad-4e15-aee0-5381edf9108e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.027519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff51a74-ebad-4e15-aee0-5381edf9108e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.034248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bdb1fa-a00c-4973-b43f-ae6381ab403c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.049790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 418/822] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:24:44 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:45.054721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff51a74-ebad-4e15-aee0-5381edf9108e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.062721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:45.081471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.082151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.082433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.082705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.083280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.084762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:45.096830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:45.097945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 03:24:45.098824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:45.103224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 405/823] 10.222.0.48 () {56 vars in 1129 bytes} [Sat Sep 17 03:24:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:45.104323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.202969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:45.219863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff51a74-ebad-4e15-aee0-5381edf9108e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.224307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d3638-2750-4f43-888e-47c8de068116 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.266109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.266761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.267038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.267309 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.275777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dbc58-11ef-47a3-88b7-f0129ad113ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.277057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbc58-11ef-47a3-88b7-f0129ad113ac None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.277523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbc58-11ef-47a3-88b7-f0129ad113ac None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.278060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbc58-11ef-47a3-88b7-f0129ad113ac None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/e5757b587e93429bacdf4a1b7f17d00a/roles/92f1f6b31904491bb73824b634599912` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.278165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.279606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:45.299228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:45.300268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:45.301175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:45.301175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:45.301175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:45.305568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 406/824] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:45.305568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.308724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dbc58-11ef-47a3-88b7-f0129ad113ac None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=e5757b587e93429bacdf4a1b7f17d00a, role_id=92f1f6b31904491bb73824b634599912)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.308724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78dbc58-11ef-47a3-88b7-f0129ad113ac None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.325311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 419/825] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:24:45 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/e5757b587e93429bacdf4a1b7f17d00a/roles/92f1f6b31904491bb73824b634599912 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:24:45.330217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dbc58-11ef-47a3-88b7-f0129ad113ac None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.357255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:45.439113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bddb0a8-118e-4188-8946-1bcd04a05c12 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.464726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dbc58-11ef-47a3-88b7-f0129ad113ac None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.480152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.481588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.482128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.482570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.483488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:45.484043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.485720 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.491496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 407/826] 10.222.0.48 () {56 vars in 1124 bytes} [Sat Sep 17 03:24:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:45.497707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.509830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.510786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.511231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.511676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.514101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:45.514232 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.515633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.528120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:45.528410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 420/827] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:45.538162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.622587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00385bc1-622f-4e5e-b990-fb54217b5108 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.623530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:45.656412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0d6ada-d5d1-4a2f-b678-9c78bf256b03 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.659588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.660364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.660776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.661179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.662048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:45.662527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.664034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.669809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 408/828] 10.222.0.48 () {56 vars in 1124 bytes} [Sat Sep 17 03:24:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:45.675450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.704846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.705883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.706599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.707071 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.716723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.718641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:45.732140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:45.733112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:45.734179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:45.734179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:45.734179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:45.734179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:45.734179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:45.734179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:45.734179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:45.734179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:45.736681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 421/829] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:45.742240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.804914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592063db-143b-4b29-9624-5fba650f29c7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.805462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:45.849128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0b44-dfaf-4c21-aaa0-cd3023827286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.849921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700063a4-d3a9-47a6-9e5d-a200fc9b8acd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:45.850338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0b44-dfaf-4c21-aaa0-cd3023827286 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.850792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0b44-dfaf-4c21-aaa0-cd3023827286 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.851231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0b44-dfaf-4c21-aaa0-cd3023827286 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.852268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0b44-dfaf-4c21-aaa0-cd3023827286 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.854608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0b44-dfaf-4c21-aaa0-cd3023827286 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.884640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 409/830] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:24:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:45.898861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff3f3e-2dc0-4e5f-b316-bcdaddcf1bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:45.899944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3f3e-2dc0-4e5f-b316-bcdaddcf1bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:45.900491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3f3e-2dc0-4e5f-b316-bcdaddcf1bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:45.900964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff3f3e-2dc0-4e5f-b316-bcdaddcf1bd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:45.901986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3f3e-2dc0-4e5f-b316-bcdaddcf1bd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:45.902556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3f3e-2dc0-4e5f-b316-bcdaddcf1bd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:45.904370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff3f3e-2dc0-4e5f-b316-bcdaddcf1bd3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:45.920217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 422/831] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:45.929891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0b44-dfaf-4c21-aaa0-cd3023827286 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:45.957923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:46.059999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0b44-dfaf-4c21-aaa0-cd3023827286 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:46.094090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feed1d-60c1-49f2-9603-f2f7f07995cf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:46.094814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feed1d-60c1-49f2-9603-f2f7f07995cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:46.095537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feed1d-60c1-49f2-9603-f2f7f07995cf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:46.098347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 423/832] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:24:46.101849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cdb6-184e-4b02-b276-9f8f14019629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:46.102842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cdb6-184e-4b02-b276-9f8f14019629 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:46.103326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cdb6-184e-4b02-b276-9f8f14019629 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:46.103771 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582cdb6-184e-4b02-b276-9f8f14019629 None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/004e85a47ddd40f89d65bc5ffa817dc6/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:46.104097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cc45-2c36-4ed9-9ba6-8d789028ab92 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:46.104383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cc45-2c36-4ed9-9ba6-8d789028ab92 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:46.104655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3cc45-2c36-4ed9-9ba6-8d789028ab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:46.106549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cdb6-184e-4b02-b276-9f8f14019629 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=004e85a47ddd40f89d65bc5ffa817dc6, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:46.108190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582cdb6-184e-4b02-b276-9f8f14019629 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:46.125828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 410/833] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:24:45 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/004e85a47ddd40f89d65bc5ffa817dc6/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:24:46.126780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8ab3cc45-2c36-4ed9-9ba6-8d789028ab92 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:46.128024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8ab3cc45-2c36-4ed9-9ba6-8d789028ab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:46.209934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 424/834] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:24:46.470910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cdb6-184e-4b02-b276-9f8f14019629 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:46.554588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:46.574371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582cdb6-184e-4b02-b276-9f8f14019629 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:46.609379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:46.610348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:46.610892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:46.611299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:46.612012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:46.613522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:46.622519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:46.623672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:46.624768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:46.627229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 411/835] 10.222.0.48 () {56 vars in 1132 bytes} [Sat Sep 17 03:24:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:46.637774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3cc45-2c36-4ed9-9ba6-8d789028ab92 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:46.681779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:46.735778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3cc45-2c36-4ed9-9ba6-8d789028ab92 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:46.769972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074934b-15ef-450d-8677-bdbe339b3cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:46.770813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074934b-15ef-450d-8677-bdbe339b3cae None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:46.771251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074934b-15ef-450d-8677-bdbe339b3cae None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:46.771677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074934b-15ef-450d-8677-bdbe339b3cae None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:46.772438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074934b-15ef-450d-8677-bdbe339b3cae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:46.772874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074934b-15ef-450d-8677-bdbe339b3cae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:46.774435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074934b-15ef-450d-8677-bdbe339b3cae None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:46.779262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 425/836] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:24:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:46.786866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:46.888804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f07421-8e6b-41a8-9a1a-15023901839b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:46.926343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0958e-ce75-4fa6-9cdf-f2f0cae51d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:46.927039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0958e-ce75-4fa6-9cdf-f2f0cae51d00 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:46.927375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0958e-ce75-4fa6-9cdf-f2f0cae51d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:46.927644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0958e-ce75-4fa6-9cdf-f2f0cae51d00 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:46.928406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0958e-ce75-4fa6-9cdf-f2f0cae51d00 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:46.928710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0958e-ce75-4fa6-9cdf-f2f0cae51d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:46.930137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0958e-ce75-4fa6-9cdf-f2f0cae51d00 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:46.935677 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 412/837] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:24:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:47.514081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175d10-5e95-4ffb-bd91-830e59e308db None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:47.514479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175d10-5e95-4ffb-bd91-830e59e308db None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:47.514654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0175d10-5e95-4ffb-bd91-830e59e308db None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:47.516185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 426/838] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:47.521527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65ce10-6de0-4406-8782-22c3a675d10f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:47.521879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65ce10-6de0-4406-8782-22c3a675d10f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:47.522157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65ce10-6de0-4406-8782-22c3a675d10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:47.542732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2e65ce10-6de0-4406-8782-22c3a675d10f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:47.544166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2e65ce10-6de0-4406-8782-22c3a675d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:47.547959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:47.615008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 413/839] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:47.875510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175d10-5e95-4ffb-bd91-830e59e308db None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:47.978888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0175d10-5e95-4ffb-bd91-830e59e308db None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:47.994241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:48.015643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180336-cc1f-4344-9fe1-b5674fd5de04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:48.016273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180336-cc1f-4344-9fe1-b5674fd5de04 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.016545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180336-cc1f-4344-9fe1-b5674fd5de04 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.016811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d180336-cc1f-4344-9fe1-b5674fd5de04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.027415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d180336-cc1f-4344-9fe1-b5674fd5de04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-2d180336-cc1f-4344-9fe1-b5674fd5de04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:48.032141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:48.033325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:48.035723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 427/840] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:24:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:48.039603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65ce10-6de0-4406-8782-22c3a675d10f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:48.145407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65ce10-6de0-4406-8782-22c3a675d10f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:48.180188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c726ba-f6ce-448a-93d0-e586d2db4977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:48.180802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c726ba-f6ce-448a-93d0-e586d2db4977 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.181076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c726ba-f6ce-448a-93d0-e586d2db4977 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.181345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c726ba-f6ce-448a-93d0-e586d2db4977 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.182042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c726ba-f6ce-448a-93d0-e586d2db4977 None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:48.182339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c726ba-f6ce-448a-93d0-e586d2db4977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:48.183713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c726ba-f6ce-448a-93d0-e586d2db4977 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:48.192406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 414/841] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:24:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:48.198037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180336-cc1f-4344-9fe1-b5674fd5de04 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:48.245404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d136e-c2b3-4939-80c7-b28f1efff7e8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.245719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d136e-c2b3-4939-80c7-b28f1efff7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.245998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d136e-c2b3-4939-80c7-b28f1efff7e8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.247342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 415/842] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:24:48.253503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f469bb-9c85-4f9d-a9ef-c890288c0ea1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.253960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f469bb-9c85-4f9d-a9ef-c890288c0ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.254235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f469bb-9c85-4f9d-a9ef-c890288c0ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.261812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:48.276968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-69f469bb-9c85-4f9d-a9ef-c890288c0ea1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:48.278416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-69f469bb-9c85-4f9d-a9ef-c890288c0ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:48.319618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d180336-cc1f-4344-9fe1-b5674fd5de04 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:48.363576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934680ed-3536-4341-a6ff-01a72c105713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:48.364213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934680ed-3536-4341-a6ff-01a72c105713 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.364489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934680ed-3536-4341-a6ff-01a72c105713 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.364758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934680ed-3536-4341-a6ff-01a72c105713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.376900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934680ed-3536-4341-a6ff-01a72c105713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:48.377867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 416/843] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:24:48.378910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934680ed-3536-4341-a6ff-01a72c105713 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-934680ed-3536-4341-a6ff-01a72c105713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:48.394141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:48.395135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:48.396124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:48.396124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:48.396124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:48.398211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 428/844] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:48.404064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f469bb-9c85-4f9d-a9ef-c890288c0ea1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:48.452664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359dc7-ad8d-4fcf-b3fa-2d4415454e67 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.453302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359dc7-ad8d-4fcf-b3fa-2d4415454e67 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.453826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359dc7-ad8d-4fcf-b3fa-2d4415454e67 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.455633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 429/845] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:24:48.461487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e211f-28fc-4512-8a64-83c361cef1b7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.461998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e211f-28fc-4512-8a64-83c361cef1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.462473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e211f-28fc-4512-8a64-83c361cef1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.481508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c00e211f-28fc-4512-8a64-83c361cef1b7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:48.483025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c00e211f-28fc-4512-8a64-83c361cef1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:48.502326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:48.521978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f469bb-9c85-4f9d-a9ef-c890288c0ea1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:48.552154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:48.557600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:48.558501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.559302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.560133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.560740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:48.561400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:48.563001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 430/846] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:48.565889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:48.580701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 417/847] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:48.586662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e211f-28fc-4512-8a64-83c361cef1b7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:48.650310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:48.694424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e211f-28fc-4512-8a64-83c361cef1b7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:48.738229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:48.738871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.739145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.739551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.747777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:48.749218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:48.760404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6856a45f-bd92-4755-85f5-545d7c64c692 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:48.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:48.763903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:48.764873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:48.768819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 431/848] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:24:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:48.770063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:48.786083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:48.810748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:48.812466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.812943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.813404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.814259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:48.816357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:48.827768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:48.828786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:48.829628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:48.832379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 418/849] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:48.833464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:48.877385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099d44-9012-45fc-95f4-b0c2fe265030 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:48.902406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:48.914019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:48.914641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:48.914893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:48.915253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:48.915980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:48.916291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:48.917701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:48.935324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 432/850] 10.222.0.48 () {56 vars in 1149 bytes} [Sat Sep 17 03:24:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:48.936146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:48.954322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d8ad6-0f6e-4168-b849-fce71bc97cac None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.002178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9cf97-5832-4e6c-8125-f6e6c8f0b5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.002846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cf97-5832-4e6c-8125-f6e6c8f0b5ef None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.003148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cf97-5832-4e6c-8125-f6e6c8f0b5ef None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.003418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9cf97-5832-4e6c-8125-f6e6c8f0b5ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.016249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9cf97-5832-4e6c-8125-f6e6c8f0b5ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:49.018534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-39d9cf97-5832-4e6c-8125-f6e6c8f0b5ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:49.021354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:49.022699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:49.023592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 419/851] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:49.024293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9cf97-5832-4e6c-8125-f6e6c8f0b5ef None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.057449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496876d-3ee9-47c8-90d9-a057d7ecd160 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.091886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.092491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.092763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.093022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.093647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:49.093970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.095323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.100106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 433/852] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:49.105258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.127205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9cf97-5832-4e6c-8125-f6e6c8f0b5ef None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.144492 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:49.162172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436a1887-989a-45f9-b4e3-139dfcdc6285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.162752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1887-989a-45f9-b4e3-139dfcdc6285 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.163027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1887-989a-45f9-b4e3-139dfcdc6285 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.163312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436a1887-989a-45f9-b4e3-139dfcdc6285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.202513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8487024-129a-45da-827a-97ed5ee0a3f5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.228615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a1887-989a-45f9-b4e3-139dfcdc6285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.230112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436a1887-989a-45f9-b4e3-139dfcdc6285 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.235853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.236459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.236733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.236997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.238084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:49.238389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.240083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.241852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:49.250001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 434/853] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:49.251387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.328537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 420/854] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:24:49.329793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d177-f485-4783-93bd-0a0682e7a3f1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.330084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d177-f485-4783-93bd-0a0682e7a3f1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.330355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d257d177-f485-4783-93bd-0a0682e7a3f1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.331573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 421/855] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:49.332262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d177-f485-4783-93bd-0a0682e7a3f1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.349903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:49.351760 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0cf5a1-c183-4dd9-a0ae-fcfefebcbd52 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.383420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.384015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.384292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.384559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.385182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:49.385487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.386869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.391447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 435/856] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:49.392216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.454318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d257d177-f485-4783-93bd-0a0682e7a3f1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.459129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:49.491810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7295d8e8-cac8-484f-853a-5a102f9c5ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.492461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d8e8-cac8-484f-853a-5a102f9c5ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.492732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d8e8-cac8-484f-853a-5a102f9c5ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.492995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d8e8-cac8-484f-853a-5a102f9c5ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.503800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295d8e8-cac8-484f-853a-5a102f9c5ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.505328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7295d8e8-cac8-484f-853a-5a102f9c5ab5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.507450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edeeb36-b177-4187-927c-6ecad92d6d45 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-7295d8e8-cac8-484f-853a-5a102f9c5ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:49.522180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:49.523250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:49.524165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:49.524165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:49.524165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:49.524165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 422/857] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:49.525535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0e58c-beed-4191-aec5-f266fd796504 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.525535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0e58c-beed-4191-aec5-f266fd796504 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.525535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0e58c-beed-4191-aec5-f266fd796504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.544474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-56e0e58c-beed-4191-aec5-f266fd796504 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:49.545929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-56e0e58c-beed-4191-aec5-f266fd796504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:49.550937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.551577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.551849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.552120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.564698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.566191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:49.581468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:49.582495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:49.583395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:49.583395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:49.583395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:49.583395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 436/858] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:49.583879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.621120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:49.627528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 423/859] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:49 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:49.628128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0e58c-beed-4191-aec5-f266fd796504 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.707910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea64e982-4e5c-4294-aab3-8eb02d8559e9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.725938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:49.735251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0e58c-beed-4191-aec5-f266fd796504 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.752965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.754210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.754714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.755177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.756091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:49.757001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.758767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.774103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.774768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.775044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.775312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.776040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:49.776285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.777668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.778811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 437/860] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:49.786636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.791963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 424/861] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:49.798987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.876712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:49.893643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422114c-aa4e-44e5-a26d-3cfe4d0fd6ea None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.925705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34a842-b700-4dfa-bfde-f8ed14081738 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:49.931559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.932198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.932468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.932738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.941646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.943812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:49.955784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:49.956914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:49.957890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 438/862] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:49.958530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:49.965862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:49.966506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:49.966782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:49.967051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:49.975943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:49.977569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:49.989909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:49.990902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 425/863] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:49.997119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:50.003163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:50.078277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd60ff-b709-4321-9f16-035d7e15bd0d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:50.098405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d90e4a-3694-4cc9-bb80-4cbc3159ac35 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:50.115792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:50.116962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488adf64-bab6-4738-a526-321242c1fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:50.117528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488adf64-bab6-4738-a526-321242c1fbf2 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:50.117812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488adf64-bab6-4738-a526-321242c1fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:50.118084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488adf64-bab6-4738-a526-321242c1fbf2 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:50.118755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488adf64-bab6-4738-a526-321242c1fbf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:50.120120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488adf64-bab6-4738-a526-321242c1fbf2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:50.134307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:50.134939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:50.135507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:50.135614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 439/864] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:24:49 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:50.136077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488adf64-bab6-4738-a526-321242c1fbf2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:50.146666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:50.147049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:50.147360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:50.148894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:50.169779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 426/865] 10.222.0.48 () {56 vars in 1135 bytes} [Sat Sep 17 03:24:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:50.176023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:50.262916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:50.286202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488adf64-bab6-4738-a526-321242c1fbf2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:50.310646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da81e5-f136-45f5-b8d9-3cf23868f00b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:50.332852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:50.333466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:50.333740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:50.334076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:50.335321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:50.335621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:50.337782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:50.351148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 440/866] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:50.353900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93ab24-f4f5-405a-ad91-49bcb93567e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:50.354688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93ab24-f4f5-405a-ad91-49bcb93567e3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:50.354969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93ab24-f4f5-405a-ad91-49bcb93567e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:50.355239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93ab24-f4f5-405a-ad91-49bcb93567e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:50.357472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:50.409376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:50.434789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93ab24-f4f5-405a-ad91-49bcb93567e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:50.436621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93ab24-f4f5-405a-ad91-49bcb93567e3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:50.488612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb176cd7-8cfd-4e36-a42e-8f932e0557e1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:50.523959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:50.524849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:50.525346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:50.525829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:50.526787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=e5757b587e93429bacdf4a1b7f17d00a) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:50.527269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:50.528857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:50.535540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 441/867] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:50 2022] GET /identity/v3/role_assignments?user.id=e5757b587e93429bacdf4a1b7f17d00a&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:50.566249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 427/868] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:50 2022] GET /identity/v3/auth/tokens => generated 1271 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 03:24:50.571841 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:50.588847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:50.685458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e24f2-704f-4428-baa5-bbec75b3e1de None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:50.722138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:50.722776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:50.723058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:50.723331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:50.734479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:50.735930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:50.750403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:50.751428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:50.752352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:50.752352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:50.752352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:50.752352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 442/869] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:50.758818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93ab24-f4f5-405a-ad91-49bcb93567e3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:50.840753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:50.869552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93ab24-f4f5-405a-ad91-49bcb93567e3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:50.904971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:50.905584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:50.905889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:50.906159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:50.906800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:50.907102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:50.908550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:50.920778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 428/870] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:50.926872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:51.005175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:51.044873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9b816-c747-41e0-8c34-9e0ec9735b4a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:51.078742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:51.079387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:51.079661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:51.079987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:51.087525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:51.089023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:51.102460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:51.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:51.104512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 443/871] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:51.111324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:51.217673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab3ee8-0431-43ee-ac43-23ba36bd2785 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:51.252162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e70cb-a300-4a3a-9f50-e5821d93ad67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:51.253112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e70cb-a300-4a3a-9f50-e5821d93ad67 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:51.253585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e70cb-a300-4a3a-9f50-e5821d93ad67 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:51.254162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e70cb-a300-4a3a-9f50-e5821d93ad67 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:51.255069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e70cb-a300-4a3a-9f50-e5821d93ad67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:51.255577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e70cb-a300-4a3a-9f50-e5821d93ad67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:51.257261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e70cb-a300-4a3a-9f50-e5821d93ad67 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:51.260228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:51.270684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 429/872] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:51.277018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:51.379414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a604bf-4e5f-41d4-aaee-7d8d342154c7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:51.403503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:51.415301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4a7ca-d8dc-4c51-905b-bcadd84f814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:51.415918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a7ca-d8dc-4c51-905b-bcadd84f814f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:51.416192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a7ca-d8dc-4c51-905b-bcadd84f814f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:51.416462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4a7ca-d8dc-4c51-905b-bcadd84f814f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:51.417198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a7ca-d8dc-4c51-905b-bcadd84f814f None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=004e85a47ddd40f89d65bc5ffa817dc6) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:51.417501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a7ca-d8dc-4c51-905b-bcadd84f814f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:51.418962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4a7ca-d8dc-4c51-905b-bcadd84f814f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:51.426140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 444/873] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:51 2022] GET /identity/v3/role_assignments?user.id=004e85a47ddd40f89d65bc5ffa817dc6&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:51.564968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918834-3fbe-4b34-9102-20d97a28a82c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:51.565312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918834-3fbe-4b34-9102-20d97a28a82c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:51.565519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd918834-3fbe-4b34-9102-20d97a28a82c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:51.567158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 430/874] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:51.572771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cac0eb-fd95-4f29-91e1-f954a65be0b8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:51.573078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cac0eb-fd95-4f29-91e1-f954a65be0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:51.573316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cac0eb-fd95-4f29-91e1-f954a65be0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:51.594027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d3cac0eb-fd95-4f29-91e1-f954a65be0b8 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:51.595270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3cac0eb-fd95-4f29-91e1-f954a65be0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:51.670644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 445/875] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:51 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:51.937122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd918834-3fbe-4b34-9102-20d97a28a82c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:52.040887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd918834-3fbe-4b34-9102-20d97a28a82c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:52.075342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0374611-80e1-4bb8-957c-0e7cf5d2fb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:52.075959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0374611-80e1-4bb8-957c-0e7cf5d2fb55 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:52.076233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0374611-80e1-4bb8-957c-0e7cf5d2fb55 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:52.076499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0374611-80e1-4bb8-957c-0e7cf5d2fb55 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:52.077158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0374611-80e1-4bb8-957c-0e7cf5d2fb55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:52.078568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0374611-80e1-4bb8-957c-0e7cf5d2fb55 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:52.097893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 431/876] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:24:51 2022] POST /identity/v3/services => generated 251 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:52.388821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393893-306e-40f3-a1ef-d67d6d20f6ff None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:52.389954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393893-306e-40f3-a1ef-d67d6d20f6ff None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:52.390457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393893-306e-40f3-a1ef-d67d6d20f6ff None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:52.392445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 446/877] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:52.398797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dd120-9b98-4e45-81bb-d74aeeafc728 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:52.399795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dd120-9b98-4e45-81bb-d74aeeafc728 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:52.400295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760dd120-9b98-4e45-81bb-d74aeeafc728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:52.419160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-760dd120-9b98-4e45-81bb-d74aeeafc728 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:52.420718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-760dd120-9b98-4e45-81bb-d74aeeafc728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:52.476218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:52.500184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 432/878] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:52.760667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73393893-306e-40f3-a1ef-d67d6d20f6ff None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:52.869230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73393893-306e-40f3-a1ef-d67d6d20f6ff None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:52.887174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:52.887851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae306-54de-48aa-b5ce-f7175f7ffe49 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:52.888136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae306-54de-48aa-b5ce-f7175f7ffe49 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:52.888407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ae306-54de-48aa-b5ce-f7175f7ffe49 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:52.889932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 433/879] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:52.895927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea2f6-2728-41fd-b225-95562ecbd774 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:52.896522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea2f6-2728-41fd-b225-95562ecbd774 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:52.896522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eea2f6-2728-41fd-b225-95562ecbd774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:52.905678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:52.906562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:52.906976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:52.907383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:52.908100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:52.909611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:52.915598 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-15eea2f6-2728-41fd-b225-95562ecbd774 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:52.917017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-15eea2f6-2728-41fd-b225-95562ecbd774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:52.919414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:52.920336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:52.921227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 447/880] 10.222.0.48 () {56 vars in 1132 bytes} [Sat Sep 17 03:24:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:52.930700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:52.998847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 434/881] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:53.050786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d9370-16b3-41f4-a6cb-1d0db804015b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:53.085354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:53.085987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.086263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.086532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.087162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:53.087461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:53.088822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:53.097880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 448/882] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:24:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:53.099676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eea2f6-2728-41fd-b225-95562ecbd774 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:53.200455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eea2f6-2728-41fd-b225-95562ecbd774 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:53.214106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:53.236176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:53.236795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.237072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.237341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.238046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:53.238350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:53.239864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:53.245230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 435/883] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:24:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:53.251151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:53.265410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:53.308196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:53.373932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d4b16-1369-47e0-9cc4-a997bd3eee77 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:53.394525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d5f9f7-3d7d-4e50-be80-bd12003fc603 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:53.410124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:53.411514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.412118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.412590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.413493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] RBAC: Adding query filter params (interface=public, service_id=3ac8180829834f0d8f64a1fa047610c4, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:53.414026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:53.415607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:53.425845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 449/884] 10.222.0.48 () {56 vars in 1251 bytes} [Sat Sep 17 03:24:53 2022] GET /identity/v3/endpoints?service_id=3ac8180829834f0d8f64a1fa047610c4&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:53.427039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:53.434617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515fcb9-b019-4993-97d7-e0821f1f87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:53.435266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515fcb9-b019-4993-97d7-e0821f1f87b1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.435543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515fcb9-b019-4993-97d7-e0821f1f87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.435813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515fcb9-b019-4993-97d7-e0821f1f87b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.449819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515fcb9-b019-4993-97d7-e0821f1f87b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b515fcb9-b019-4993-97d7-e0821f1f87b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:53.457859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:53.458913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:24:53.459768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:53.461832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 436/885] 10.222.0.48 () {56 vars in 1120 bytes} [Sat Sep 17 03:24:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:53.465803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515fcb9-b019-4993-97d7-e0821f1f87b1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:53.511286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:53.545309 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c053-7383-4c24-97a9-8131995df17c None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:53.557607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:53.591545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82759a6-7401-4f29-bbc6-3f828e3e4a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:53.592091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82759a6-7401-4f29-bbc6-3f828e3e4a75 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.592372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82759a6-7401-4f29-bbc6-3f828e3e4a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.592646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82759a6-7401-4f29-bbc6-3f828e3e4a75 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.593560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82759a6-7401-4f29-bbc6-3f828e3e4a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:53.595112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82759a6-7401-4f29-bbc6-3f828e3e4a75 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:53.595878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515fcb9-b019-4993-97d7-e0821f1f87b1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:53.605801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 450/886] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:24:53 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:24:53.647582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fa81a1-a90b-4930-b73b-da33309de90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:53.648335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa81a1-a90b-4930-b73b-da33309de90d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.648619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa81a1-a90b-4930-b73b-da33309de90d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.648897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fa81a1-a90b-4930-b73b-da33309de90d None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.649577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa81a1-a90b-4930-b73b-da33309de90d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:53.649907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa81a1-a90b-4930-b73b-da33309de90d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:53.651318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fa81a1-a90b-4930-b73b-da33309de90d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:53.661236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 437/887] 10.222.0.48 () {56 vars in 1115 bytes} [Sat Sep 17 03:24:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:53.667327 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82759a6-7401-4f29-bbc6-3f828e3e4a75 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:53.720179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d0d26-020e-4eca-9fac-0a90623bd51f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.720514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d0d26-020e-4eca-9fac-0a90623bd51f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.720734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126d0d26-020e-4eca-9fac-0a90623bd51f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.722395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 438/888] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:53.727957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0fc59-f155-4154-8100-cbfed871534a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.728240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0fc59-f155-4154-8100-cbfed871534a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.728504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0fc59-f155-4154-8100-cbfed871534a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.751637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dcb0fc59-f155-4154-8100-cbfed871534a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:53.753857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dcb0fc59-f155-4154-8100-cbfed871534a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:53.795544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82759a6-7401-4f29-bbc6-3f828e3e4a75 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:53.836765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:53.837791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:53.838270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:53.838760 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:53.848927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 439/889] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:24:53.851950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:53.853615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:53.868916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:53.869954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:53.870864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:53.870864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:53.870864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:53.872977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 451/890] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:53.877882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0fc59-f155-4154-8100-cbfed871534a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:53.907054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:53.980179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0fc59-f155-4154-8100-cbfed871534a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.017818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:54.018436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.018710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.018975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.019612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:54.019908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:54.021312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:54.033429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 440/891] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:54.038962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:54.069060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:54.116747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:54.149628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f8b31-40f2-497e-b212-52d60d533190 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.189704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:54.191303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.191583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.191862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.201919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:54.203574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:54.210069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:54.219109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:54.221227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:54.222780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 452/892] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:24:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:54.229789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d389d6f-1376-42bb-94a2-9a14091b0244 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.230009 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:54.271330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:54.272002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.272330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.272597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.273176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:54.274623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:54.283661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:54.285967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:24:54.288078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:54.289868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 441/893] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:24:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:54.297792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:54.333614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:54.351546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285370bf-9944-4bf9-b18c-f0b6b43072a6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.388486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35cc82-d148-4b64-a138-7955c369d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:54.389091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35cc82-d148-4b64-a138-7955c369d338 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.389365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35cc82-d148-4b64-a138-7955c369d338 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.389811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35cc82-d148-4b64-a138-7955c369d338 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.390912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35cc82-d148-4b64-a138-7955c369d338 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:54.391211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35cc82-d148-4b64-a138-7955c369d338 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:54.392896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35cc82-d148-4b64-a138-7955c369d338 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:54.408334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3a2a5-4b10-4e99-a83a-84528d6f535b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.417822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 453/894] 10.222.0.48 () {56 vars in 1149 bytes} [Sat Sep 17 03:24:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:54.417822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd38db-0f32-48ad-ad55-691ed16dfae8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.417822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd38db-0f32-48ad-ad55-691ed16dfae8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.417822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd38db-0f32-48ad-ad55-691ed16dfae8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.417822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 454/895] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:54.418671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd38db-0f32-48ad-ad55-691ed16dfae8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:54.449385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b912e89-de23-467b-a00f-ac6113b224ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:54.450099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912e89-de23-467b-a00f-ac6113b224ee None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.450364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912e89-de23-467b-a00f-ac6113b224ee None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.450561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912e89-de23-467b-a00f-ac6113b224ee None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.451236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b912e89-de23-467b-a00f-ac6113b224ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:54.451485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b912e89-de23-467b-a00f-ac6113b224ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:54.452858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b912e89-de23-467b-a00f-ac6113b224ee None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:54.461815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 442/896] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:24:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:54.461815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5f41-c029-4f7b-80a8-21eac9fa2541 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.461815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5f41-c029-4f7b-80a8-21eac9fa2541 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.461815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d5f41-c029-4f7b-80a8-21eac9fa2541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.479095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f93d5f41-c029-4f7b-80a8-21eac9fa2541 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:54.480383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f93d5f41-c029-4f7b-80a8-21eac9fa2541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:54.492505 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:54.530125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd38db-0f32-48ad-ad55-691ed16dfae8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.551041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 443/897] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:54.551704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5f41-c029-4f7b-80a8-21eac9fa2541 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:54.581448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf309d-e0d4-4e1b-af56-cfbaf17d5d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:54.582505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf309d-e0d4-4e1b-af56-cfbaf17d5d54 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.583355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf309d-e0d4-4e1b-af56-cfbaf17d5d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.584012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf309d-e0d4-4e1b-af56-cfbaf17d5d54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.605238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:54.656786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d5f41-c029-4f7b-80a8-21eac9fa2541 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.676478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf309d-e0d4-4e1b-af56-cfbaf17d5d54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:54.678726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bf309d-e0d4-4e1b-af56-cfbaf17d5d54 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:54.692569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:54.693335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.693700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.694108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:54.694876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:54.695262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:54.696742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:54.701798 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 444/898] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:24:54 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:54.798665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 455/899] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:24:54 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 03:24:54.805080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:54.819176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:54.826242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf309d-e0d4-4e1b-af56-cfbaf17d5d54 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:54.880367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:54.928873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a0fe-6d0b-464f-a09d-3daaf505704b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.950657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf309d-e0d4-4e1b-af56-cfbaf17d5d54 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:54.981054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:54.981711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:54.982695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:54.982695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.000331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.001818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.004935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.005954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.006466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.006972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.007768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.009506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:55.017029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:55.018060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:55.018997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:55.018997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:55.018997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:55.018997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 445/900] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:55.022163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:55.023164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:55.024001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:55.024738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:55.031130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 456/901] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:55.032302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:55.090746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:55.136249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86de55-e634-4e94-ad5e-fe97304e803f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:55.153128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a49f2-3c97-471f-ab9b-748ce0812d43 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:55.164044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:55.182935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.184368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.184812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.185495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.186328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:55.187007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.189389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.192945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.193696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.194092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.194456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.195174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:55.195569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.197558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.203277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 457/902] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:55.209136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:55.212061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 446/903] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:55.217664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:55.318773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faa69f-e117-4ead-9d45-144018dc4d60 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:55.332101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae0830c-c492-4489-9e4b-28b8f8058221 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:55.354823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.355430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.355698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.355960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.356586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:55.356881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.358272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.358561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:55.364277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 458/904] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:55.370060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:55.376339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.376980 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.377262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.377533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.384721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.386387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:24:55.400144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:55.401095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:55.402049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:24:55.402049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:24:55.402049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:24:55.402049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:24:55.402049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:24:55.402049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:24:55.402049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:24:55.402049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:55.405837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 447/905] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:55.408869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:55.415164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:55.498142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d441a2-7cee-4693-bf1d-a93fc77c5405 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:55.524567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ccb02-8811-4494-b8c2-06178ec91cb8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:55.544455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.545588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.546002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.546365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.547168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] RBAC: Adding query filter params (interface=public, service_id=e56af1358f3847ab8f98e4d18b79eb05, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:55.548095 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.549940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.557857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 459/906] 10.222.0.48 () {56 vars in 1251 bytes} [Sat Sep 17 03:24:55 2022] GET /identity/v3/endpoints?service_id=e56af1358f3847ab8f98e4d18b79eb05&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:55.563765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:55.564737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.565354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.565627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.565934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.566738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:55.567146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.568649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.582221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 448/907] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:24:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:55.594783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:55.652006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:55.674689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:55.677917 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197a326-c66a-488c-bb93-750dc045e038 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:55.719794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d8168-b83b-41ad-af05-cbf5f27d7717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.720421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8168-b83b-41ad-af05-cbf5f27d7717 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.720695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8168-b83b-41ad-af05-cbf5f27d7717 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.720964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d8168-b83b-41ad-af05-cbf5f27d7717 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.721582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d8168-b83b-41ad-af05-cbf5f27d7717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.723050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d8168-b83b-41ad-af05-cbf5f27d7717 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.733917 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 460/908] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:24:55 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:24:55.746151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a2194-b774-4dc5-9cdf-c816d36e6015 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:55.791510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0139d7f-8f41-420d-b459-f723812bd063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:55.792606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d7f-8f41-420d-b459-f723812bd063 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.793083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d7f-8f41-420d-b459-f723812bd063 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.793562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0139d7f-8f41-420d-b459-f723812bd063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.794529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139d7f-8f41-420d-b459-f723812bd063 None admin] RBAC: Adding query filter params (role.id=266b7d0aa48a4b4f83f29fd5699aa155, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=e5757b587e93429bacdf4a1b7f17d00a) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:55.795053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139d7f-8f41-420d-b459-f723812bd063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:55.796858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0139d7f-8f41-420d-b459-f723812bd063 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:55.804135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 449/909] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:24:55 2022] GET /identity/v3/role_assignments?user.id=e5757b587e93429bacdf4a1b7f17d00a&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=266b7d0aa48a4b4f83f29fd5699aa155 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:55.882733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d34be-72f1-4da6-a477-484f39d373f5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.883413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d34be-72f1-4da6-a477-484f39d373f5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.883910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d34be-72f1-4da6-a477-484f39d373f5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.886118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 461/910] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:55.892384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f367a9-6961-4489-ad8f-79ddb3970454 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:55.893028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f367a9-6961-4489-ad8f-79ddb3970454 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:55.893503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f367a9-6961-4489-ad8f-79ddb3970454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:55.914113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-39f367a9-6961-4489-ad8f-79ddb3970454 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:55.915812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-39f367a9-6961-4489-ad8f-79ddb3970454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:56.004023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 450/911] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:55 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:56.264217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d34be-72f1-4da6-a477-484f39d373f5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:56.367533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d34be-72f1-4da6-a477-484f39d373f5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:56.406157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:56.406850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:56.407131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:56.407404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:56.407989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:56.409375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:56.419984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:56.420957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:56.421885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 462/912] 10.222.0.48 () {56 vars in 1132 bytes} [Sat Sep 17 03:24:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:56.427272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f367a9-6961-4489-ad8f-79ddb3970454 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:56.462933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:56.531082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f367a9-6961-4489-ad8f-79ddb3970454 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:56.570750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:56.571758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:56.572249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:56.572713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:56.573552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:56.574095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:56.575688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:56.581219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 451/913] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:24:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:56.586893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:56.619119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:56.701130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca925586-0dc1-40f8-815f-75ccadd4f008 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:56.738483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c7343-89e1-40ce-9c49-a873e8205ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:56.739097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7343-89e1-40ce-9c49-a873e8205ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:56.739425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7343-89e1-40ce-9c49-a873e8205ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:56.739698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7343-89e1-40ce-9c49-a873e8205ab7 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:56.740416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c7343-89e1-40ce-9c49-a873e8205ab7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:56.740717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c7343-89e1-40ce-9c49-a873e8205ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:56.742122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c7343-89e1-40ce-9c49-a873e8205ab7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:56.747583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 463/914] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:24:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:56.753202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:56.855888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:56.858927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f309e704-86a1-445c-9869-216c2e4a87d9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:56.897656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39145ba3-02f1-485c-bb0a-1307a2e55dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:56.898693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145ba3-02f1-485c-bb0a-1307a2e55dcc None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:56.899168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145ba3-02f1-485c-bb0a-1307a2e55dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:56.899633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39145ba3-02f1-485c-bb0a-1307a2e55dcc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:56.900510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39145ba3-02f1-485c-bb0a-1307a2e55dcc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:56.902116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39145ba3-02f1-485c-bb0a-1307a2e55dcc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:56.923372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 452/915] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:24:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:57.084778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e9ea-13c0-4192-b726-40f5ec85fd61 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:57.085454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e9ea-13c0-4192-b726-40f5ec85fd61 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:57.085966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d6e9ea-13c0-4192-b726-40f5ec85fd61 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:57.087939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 464/916] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:57.094204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e33540-8dba-4074-a453-9ccadb541678 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:57.094883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e33540-8dba-4074-a453-9ccadb541678 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:57.095353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e33540-8dba-4074-a453-9ccadb541678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:57.114547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e4e33540-8dba-4074-a453-9ccadb541678 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:57.116107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e4e33540-8dba-4074-a453-9ccadb541678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:57.190622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 453/917] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:57 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:57.455499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e9ea-13c0-4192-b726-40f5ec85fd61 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:57.555535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:57.565671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d6e9ea-13c0-4192-b726-40f5ec85fd61 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:57.600270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d707792-bb01-47b5-811e-50b8e7e9698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:57.600948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707792-bb01-47b5-811e-50b8e7e9698a None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:57.601195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707792-bb01-47b5-811e-50b8e7e9698a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:57.601425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d707792-bb01-47b5-811e-50b8e7e9698a None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:57.602125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d707792-bb01-47b5-811e-50b8e7e9698a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:57.603516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d707792-bb01-47b5-811e-50b8e7e9698a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:57.622751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 465/918] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:24:57 2022] POST /identity/v3/services => generated 241 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:24:57.961708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518625fa-04b9-4aee-a573-dbb000bab8f9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:57.962303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518625fa-04b9-4aee-a573-dbb000bab8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:57.962303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518625fa-04b9-4aee-a573-dbb000bab8f9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:57.963876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 454/919] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:57.969424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800993d-970e-4d68-88ee-54009624fe31 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:57.969704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800993d-970e-4d68-88ee-54009624fe31 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:57.970009 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4800993d-970e-4d68-88ee-54009624fe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:57.996828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4800993d-970e-4d68-88ee-54009624fe31 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:57.998293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4800993d-970e-4d68-88ee-54009624fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:58.058212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc727-5ec1-4266-b8de-37c98424a9bb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:58.058852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc727-5ec1-4266-b8de-37c98424a9bb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:58.059316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997cc727-5ec1-4266-b8de-37c98424a9bb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:58.061090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 455/920] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:24:58.066207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6bcbc-d91e-4b1f-95c2-62ba27fb7a73 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:58.066740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6bcbc-d91e-4b1f-95c2-62ba27fb7a73 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:58.067209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6bcbc-d91e-4b1f-95c2-62ba27fb7a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:58.077803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 466/921] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:24:58.086655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0dc6bcbc-d91e-4b1f-95c2-62ba27fb7a73 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:58.088098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0dc6bcbc-d91e-4b1f-95c2-62ba27fb7a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:58.154422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 456/922] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:24:58.347280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800993d-970e-4d68-88ee-54009624fe31 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:58.416856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6bcbc-d91e-4b1f-95c2-62ba27fb7a73 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:58.427686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:58.436201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:58.450420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4800993d-970e-4d68-88ee-54009624fe31 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:58.497464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0909-3e46-4589-a674-4c486f004580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:58.498119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0909-3e46-4589-a674-4c486f004580 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:58.498492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0909-3e46-4589-a674-4c486f004580 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:58.498758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c0909-3e46-4589-a674-4c486f004580 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:58.509066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c0909-3e46-4589-a674-4c486f004580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b63c0909-3e46-4589-a674-4c486f004580 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:24:58.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:58.515159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:58.516160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 467/923] 10.222.0.48 () {56 vars in 1120 bytes} [Sat Sep 17 03:24:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:58.523661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0909-3e46-4589-a674-4c486f004580 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:58.550129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6bcbc-d91e-4b1f-95c2-62ba27fb7a73 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:58.591754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:58.592400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:58.592688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:58.592962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:58.593553 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:58.595769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:58.608440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:58.610552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:58.612092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 457/924] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:58.621790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:58.652316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c0909-3e46-4589-a674-4c486f004580 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:58.692301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:58.693142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:58.693482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:58.693839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:58.694616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:58.694996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:58.696429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:58.702053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:58.702239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:58.706128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 468/925] 10.222.0.48 () {56 vars in 1115 bytes} [Sat Sep 17 03:24:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:58.712976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:58.734158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a726-b985-41ae-98e5-70d9594210bb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:58.773064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:58.773684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:58.773988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:58.774259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:58.774943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:58.775248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:58.776638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:58.782018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 458/926] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:58.791483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:58.827648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32499-b83c-461e-92ba-964e4f7491c2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:58.865141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:58.866209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:58.866482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:58.867012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:58.878490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:58.879922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:58.896358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:58.898671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:58.899848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:58.899848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:58.899848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:58.899848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 469/927] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:58.904520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:58.908675 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c8763-6fd0-461c-8f1d-a32dc3ed27a7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:58.946196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:58.946813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:58.947089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:58.947357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:58.948409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:58.948719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:58.950512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:58.957328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 459/928] 10.222.0.48 () {56 vars in 1114 bytes} [Sat Sep 17 03:24:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:58.962985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:58.966124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:58.969024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:59.036127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f87776-d04d-493b-9d77-380dd9b0d837 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:59.080514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:59.081144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.081427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.081700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.082396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:59.082987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:59.084852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:59.101362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c887c1-deb1-43b6-b66c-78019ce37b62 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:59.104431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 470/929] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:59.105326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:59.149389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9263690-bd56-4319-8b51-ea9075807748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:59.150421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263690-bd56-4319-8b51-ea9075807748 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.150909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263690-bd56-4319-8b51-ea9075807748 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.151364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9263690-bd56-4319-8b51-ea9075807748 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.152214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9263690-bd56-4319-8b51-ea9075807748 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:59.154439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9263690-bd56-4319-8b51-ea9075807748 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:59.179315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 460/930] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:24:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:24:59.180587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49f72-41e4-4406-8d75-7a000a70ddc4 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.180968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49f72-41e4-4406-8d75-7a000a70ddc4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.181249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced49f72-41e4-4406-8d75-7a000a70ddc4 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.185785 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 461/931] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:59.188202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36450d4-a319-42c2-a0ef-11a7c6a0c786 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.188487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36450d4-a319-42c2-a0ef-11a7c6a0c786 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.188757 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36450d4-a319-42c2-a0ef-11a7c6a0c786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.208140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c36450d4-a319-42c2-a0ef-11a7c6a0c786 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:59.209418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c36450d4-a319-42c2-a0ef-11a7c6a0c786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:59.237437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb996f-99b6-48d6-815a-1909d10f3a95 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:59.258863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:59.274568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:59.296479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:59.297137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.297408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.297674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.299370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 462/932] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:24:59.309817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:59.311649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:24:59.325112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:59.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:24:59.327528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:59.330085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 471/933] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:24:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:59.337824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36450d4-a319-42c2-a0ef-11a7c6a0c786 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:59.445361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36450d4-a319-42c2-a0ef-11a7c6a0c786 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:59.480851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:59.481463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.481736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.482069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.482799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:59.483101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:59.484641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:59.502882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 463/934] 10.222.0.48 () {56 vars in 1149 bytes} [Sat Sep 17 03:24:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:24:59.508365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:59.607075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:59.611960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b3671-c4e3-4e43-b42d-98274503341e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:59.653964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:59.654721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.654874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.655200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.657267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:59.670238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:59.671857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:24:59.689377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:59.690410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:24:59.691346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:24:59.691346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:24:59.691346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:24:59.691346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 472/935] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:24:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:24:59.698743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:59.728806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837c4f3-c761-4d18-8b45-df4c12efdf84 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:59.733787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:59.776266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:59.776913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.777197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.777469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] PATH_INFO: `/v3/services/compute` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.778084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:59.779537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:24:59.788858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:24:59.790004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:24:59.790872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:24:59.795184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 464/936] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:24:59.796477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:59.831148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c946b07-2137-45a2-b7a3-e0e251ee4b30 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:59.872761 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4dddc7-39da-4e5b-a39e-fb0b2eaea814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:59.873373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dddc7-39da-4e5b-a39e-fb0b2eaea814 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.873649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dddc7-39da-4e5b-a39e-fb0b2eaea814 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.873945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4dddc7-39da-4e5b-a39e-fb0b2eaea814 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.874591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4dddc7-39da-4e5b-a39e-fb0b2eaea814 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:59.874893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4dddc7-39da-4e5b-a39e-fb0b2eaea814 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:59.876260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4dddc7-39da-4e5b-a39e-fb0b2eaea814 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:59.888603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 473/937] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:59.890331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ce8ab-8eb3-4126-90db-b5a8c33e1bcb None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.890331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ce8ab-8eb3-4126-90db-b5a8c33e1bcb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.890331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ce8ab-8eb3-4126-90db-b5a8c33e1bcb None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.891795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 474/938] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:24:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:24:59.895414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ce8ab-8eb3-4126-90db-b5a8c33e1bcb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:24:59.903527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340034d-aa73-43c6-8cbf-29f9e5b9cdfd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:24:59.912462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:24:59.938311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d46de80-de7c-4f49-a192-c0051eb9c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:24:59.938933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46de80-de7c-4f49-a192-c0051eb9c23a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.939205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46de80-de7c-4f49-a192-c0051eb9c23a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.939477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d46de80-de7c-4f49-a192-c0051eb9c23a None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.940110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46de80-de7c-4f49-a192-c0051eb9c23a None admin] RBAC: Adding query filter params (name=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:24:59.940411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46de80-de7c-4f49-a192-c0051eb9c23a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:24:59.941822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d46de80-de7c-4f49-a192-c0051eb9c23a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:24:59.946586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 465/939] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:24:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:24:59.947736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011221-00ef-4c63-ad8f-3754af91031c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:24:59.948017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011221-00ef-4c63-ad8f-3754af91031c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:24:59.948287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011221-00ef-4c63-ad8f-3754af91031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:24:59.966496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3b011221-00ef-4c63-ad8f-3754af91031c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:24:59.967601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3b011221-00ef-4c63-ad8f-3754af91031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:24:59.998213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:00.017886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ce8ab-8eb3-4126-90db-b5a8c33e1bcb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:00.042160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 466/940] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:24:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:00.050941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011221-00ef-4c63-ad8f-3754af91031c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:00.054117 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:00.054781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:00.055074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:00.056109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:00.063435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:00.065061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:25:00.078160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:00.079101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:00.080032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 475/941] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:00.085057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:00.183726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011221-00ef-4c63-ad8f-3754af91031c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:00.185548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:00.216031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c9e24a-0c9a-4fff-aa50-00d1a6014030 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:00.228218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:00.229509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:00.229971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:00.230968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:00.232439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:00.233395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:00.236856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:00.250017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 467/942] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:25:00 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:00.263478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:00.264162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:00.264452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:00.264702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:00.265412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:00.265715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:00.267267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:00.281568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 476/943] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:25:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:00.291016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:00.327606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:00.332344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:00.410836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0085aa-0c7d-4678-b535-76cfa90f9763 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:00.451195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc439-1592-46b5-8a57-79ce1b2cb231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:00.451696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc439-1592-46b5-8a57-79ce1b2cb231 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:00.451977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc439-1592-46b5-8a57-79ce1b2cb231 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:00.452244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41bc439-1592-46b5-8a57-79ce1b2cb231 None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/e5757b587e93429bacdf4a1b7f17d00a/roles/266b7d0aa48a4b4f83f29fd5699aa155` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:00.454697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bc439-1592-46b5-8a57-79ce1b2cb231 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=e5757b587e93429bacdf4a1b7f17d00a, role_id=266b7d0aa48a4b4f83f29fd5699aa155)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:00.455882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41bc439-1592-46b5-8a57-79ce1b2cb231 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:00.468527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bcd79-9042-43fe-96d6-9e2b7e14b5cd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:00.471387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 468/944] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:25:00 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/e5757b587e93429bacdf4a1b7f17d00a/roles/266b7d0aa48a4b4f83f29fd5699aa155 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:25:00.518207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:00.518822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:00.519096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:00.519368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:00.519967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:00.521504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:00.531263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:00.532361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:00.533219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:00.537020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 477/945] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:25:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:25:00.539427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc439-1592-46b5-8a57-79ce1b2cb231 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:00.570874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:00.659441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41bc439-1592-46b5-8a57-79ce1b2cb231 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:00.697590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:00.698262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:00.698539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:00.699442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:00.699442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:00.699723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:00.701098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:00.706367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 469/946] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:25:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:00.712031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:00.781828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:00.817003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2b67-e011-44ba-aeac-b6261f34ea7b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:00.850766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:00.851621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:00.852091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:00.852527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:00.853310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:00.853774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:00.855394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:00.860746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 478/947] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:25:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:00.866643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:00.959935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:00.970947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ade571-4e65-4040-b91e-ff0dd0c789c8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:01.016111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b3802-cee5-40ef-b951-71e3941fe5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:01.017026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b3802-cee5-40ef-b951-71e3941fe5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:01.017484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b3802-cee5-40ef-b951-71e3941fe5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:01.017944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b3802-cee5-40ef-b951-71e3941fe5c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:01.018830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b3802-cee5-40ef-b951-71e3941fe5c7 None admin] RBAC: Adding query filter params (interface=public, service_id=2a8719ab78464aab96a9c399a42f3e08, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:01.019296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b3802-cee5-40ef-b951-71e3941fe5c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:01.020888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b3802-cee5-40ef-b951-71e3941fe5c7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:01.027111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 470/948] 10.222.0.48 () {56 vars in 1251 bytes} [Sat Sep 17 03:25:00 2022] GET /identity/v3/endpoints?service_id=2a8719ab78464aab96a9c399a42f3e08&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:01.032827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:01.136355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b6994-ef91-4122-b931-8fb72ca9b0a7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:01.170224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:01.176982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1b452-95ff-4b7f-a377-119b3f9048ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:01.177663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b452-95ff-4b7f-a377-119b3f9048ce None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:01.178045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b452-95ff-4b7f-a377-119b3f9048ce None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:01.178314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1b452-95ff-4b7f-a377-119b3f9048ce None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:01.178922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1b452-95ff-4b7f-a377-119b3f9048ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:01.180289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce1b452-95ff-4b7f-a377-119b3f9048ce None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:01.186813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 479/949] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:25:01 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:25:01.502741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddfa2-5a8a-4ffd-873e-911754cd4361 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:01.503117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddfa2-5a8a-4ffd-873e-911754cd4361 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:01.503310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddfa2-5a8a-4ffd-873e-911754cd4361 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:01.504837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 471/950] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:01.510548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f619-ca20-4851-bbe8-a8968b7cde24 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:01.510828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f619-ca20-4851-bbe8-a8968b7cde24 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:01.511092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17f619-ca20-4851-bbe8-a8968b7cde24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:01.529940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-db17f619-ca20-4851-bbe8-a8968b7cde24 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:01.531125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-db17f619-ca20-4851-bbe8-a8968b7cde24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:01.600105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 480/951] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:01.876554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ddfa2-5a8a-4ffd-873e-911754cd4361 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:01.991157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ddfa2-5a8a-4ffd-873e-911754cd4361 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:02.028595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:02.029614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:02.030140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:02.030606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:02.031495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:02.033131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:02.036485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING keystone.server.flask.common [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 17 03:25:02.060714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.sql.core [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 03:25:02.060714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 03:25:02.060714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [parameters: {'id': '30f47248beb84fd28719e35f8f9f64c2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 03:25:02.060714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 30f47248beb84fd28719e35f8f9f64c2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 30f47248beb84fd28719e35f8f9f64c2. Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 03:25:02.070117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 17 03:25:02.071039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application yield resource Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application next(self.gen) Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise self.value Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application session.commit() Sep 17 03:25:02.072087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.session.flush() Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application compat.raise_( Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 03:25:02.073010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 03:25:02.073985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application conn.query(q) Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application result.read() Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 03:25:02.074807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [parameters: {'id': '30f47248beb84fd28719e35f8f9f64c2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:02.075695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:02.076512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 30f47248beb84fd28719e35f8f9f64c2. Sep 17 03:25:02.077462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:02.081602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 472/952] 10.222.0.48 () {60 vars in 1140 bytes} [Sat Sep 17 03:25:01 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:02.093922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17f619-ca20-4851-bbe8-a8968b7cde24 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:02.197448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17f619-ca20-4851-bbe8-a8968b7cde24 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:02.232959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:02.242689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1ef07-c486-4fb7-9562-01b046f505fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:02.243330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ef07-c486-4fb7-9562-01b046f505fc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:02.243604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ef07-c486-4fb7-9562-01b046f505fc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:02.243909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ef07-c486-4fb7-9562-01b046f505fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:02.250975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1ef07-c486-4fb7-9562-01b046f505fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:02.252425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1ef07-c486-4fb7-9562-01b046f505fc None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-d6f1ef07-c486-4fb7-9562-01b046f505fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:25:02.263990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:02.266202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:02.268557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 481/953] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:25:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:02.271975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:02.287152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:02.385179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd64f747-7bd6-47ef-aedf-765c38f7f929 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:02.421870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb49833-0f90-481c-a259-4beb36ddd84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:02.422909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb49833-0f90-481c-a259-4beb36ddd84d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:02.423402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb49833-0f90-481c-a259-4beb36ddd84d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:02.423871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb49833-0f90-481c-a259-4beb36ddd84d None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:02.424728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb49833-0f90-481c-a259-4beb36ddd84d None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:02.425223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb49833-0f90-481c-a259-4beb36ddd84d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:02.427177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb49833-0f90-481c-a259-4beb36ddd84d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:02.448678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 473/954] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:25:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:02.611023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785adef-24a1-43f1-9c91-2c312ef281da None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:02.611769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785adef-24a1-43f1-9c91-2c312ef281da None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:02.612287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785adef-24a1-43f1-9c91-2c312ef281da None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:02.614178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 482/955] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:02.620298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eeafb-4b64-43d1-9242-6b55a0315e0c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:02.620645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eeafb-4b64-43d1-9242-6b55a0315e0c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:02.620919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6eeafb-4b64-43d1-9242-6b55a0315e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:02.640647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-aa6eeafb-4b64-43d1-9242-6b55a0315e0c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:02.642294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aa6eeafb-4b64-43d1-9242-6b55a0315e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:02.717725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:02.723780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 474/956] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:02.772868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a270-33ac-494f-b469-63501e66f3b8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:02.773213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a270-33ac-494f-b469-63501e66f3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:02.773409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a270-33ac-494f-b469-63501e66f3b8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:02.775039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 483/957] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:02.780383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a55ee-795a-4ad7-a765-7e09c9a017ab None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:02.780597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a55ee-795a-4ad7-a765-7e09c9a017ab None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:02.780869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a55ee-795a-4ad7-a765-7e09c9a017ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:02.799423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a21a55ee-795a-4ad7-a765-7e09c9a017ab None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:02.800592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a21a55ee-795a-4ad7-a765-7e09c9a017ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:02.867559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 475/958] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:02 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:03.007337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a270-33ac-494f-b469-63501e66f3b8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:03.114038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a270-33ac-494f-b469-63501e66f3b8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:03.149887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a55ee-795a-4ad7-a765-7e09c9a017ab None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:03.150468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446c376-9b22-478f-921a-3685a454e489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:03.150821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446c376-9b22-478f-921a-3685a454e489 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:03.151102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446c376-9b22-478f-921a-3685a454e489 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:03.151371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446c376-9b22-478f-921a-3685a454e489 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:03.152240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446c376-9b22-478f-921a-3685a454e489 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:03.154500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446c376-9b22-478f-921a-3685a454e489 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:03.171779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 484/959] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:25:03 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:03.273946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a55ee-795a-4ad7-a765-7e09c9a017ab None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:03.308544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:03.328097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2360ab81-795d-4904-8f87-667302dce673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:03.328097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ab81-795d-4904-8f87-667302dce673 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:03.328097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ab81-795d-4904-8f87-667302dce673 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:03.328097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2360ab81-795d-4904-8f87-667302dce673 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:03.340908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2360ab81-795d-4904-8f87-667302dce673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2360ab81-795d-4904-8f87-667302dce673 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:03.346306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:03.347341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:25:03.348279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:03.351526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 476/960] 10.222.0.48 () {56 vars in 1120 bytes} [Sat Sep 17 03:25:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:03.358320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446c376-9b22-478f-921a-3685a454e489 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:03.412630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:03.470478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446c376-9b22-478f-921a-3685a454e489 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:03.488907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b60b3-c0a7-4630-a8ec-0536ff054f32 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:03.489194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b60b3-c0a7-4630-a8ec-0536ff054f32 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:03.489477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b60b3-c0a7-4630-a8ec-0536ff054f32 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:03.491296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 477/961] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:03.498657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92931f47-a87b-44e1-8c8e-2e94c0cce23b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:03.498939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92931f47-a87b-44e1-8c8e-2e94c0cce23b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:03.499214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92931f47-a87b-44e1-8c8e-2e94c0cce23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:03.514433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:03.515292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:03.515709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:03.516136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:03.516953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:03.517389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:03.518923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:03.519749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-92931f47-a87b-44e1-8c8e-2e94c0cce23b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:03.521074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-92931f47-a87b-44e1-8c8e-2e94c0cce23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:03.528861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 485/962] 10.222.0.48 () {56 vars in 1115 bytes} [Sat Sep 17 03:25:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:03.538966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:03.599777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 478/963] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:03.662770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae749a-6b0f-4c38-b402-d3555cf22fd0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:03.671713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:03.698036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:03.698673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:03.698950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:03.699222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:03.710161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:03.711615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:03.725924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:03.726926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:03.727859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:03.727859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:03.727859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:03.727859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 486/964] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:25:03.734265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92931f47-a87b-44e1-8c8e-2e94c0cce23b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:03.836541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92931f47-a87b-44e1-8c8e-2e94c0cce23b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:03.854503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:03.872303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:03.872914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:03.873188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:03.873449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:03.874118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:03.874575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:03.875960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:03.876206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:03.889317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 479/965] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:03.895158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:04.004221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267dd5b-ac47-4f5f-9a75-a7563a294c29 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:04.020107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412870ae-1aad-4426-a693-4f1192c8378a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:04.043802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749782-3e22-4f88-b275-b00044592533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:04.045311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749782-3e22-4f88-b275-b00044592533 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.045738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749782-3e22-4f88-b275-b00044592533 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.046454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54749782-3e22-4f88-b275-b00044592533 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.047180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749782-3e22-4f88-b275-b00044592533 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:04.048696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54749782-3e22-4f88-b275-b00044592533 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-54749782-3e22-4f88-b275-b00044592533 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:04.058519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:04.059794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:04.060899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:04.061852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:04.062059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.062391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.062718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.063947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 487/966] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:25:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:04.069429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749782-3e22-4f88-b275-b00044592533 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:04.078594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:04.080557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:25:04.095117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:04.096256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 03:25:04.097610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:04.098567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:04.101028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 480/967] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:25:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:04.103574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:04.150378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:04.193800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54749782-3e22-4f88-b275-b00044592533 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:04.228448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4ebb7-820b-4c02-958c-4973d2c14a5e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:04.234038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:04.234846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.235267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.235679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.236464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:04.236762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:04.238161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:04.243575 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 488/968] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:25:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:04.248821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:04.268982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:04.269864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.270306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.270771 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.272142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:04.272878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:04.275140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:04.303937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 481/969] 10.222.0.48 () {56 vars in 1149 bytes} [Sat Sep 17 03:25:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:04.304629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:04.343842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:04.360840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b2f98-3b1b-401f-8724-ef7111a82605 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:04.407229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:04.408646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.409219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.409731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.410753 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:04.411217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:04.413145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:04.420491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 489/970] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:25:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:04.425666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:04.426291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:04.434221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228012c2-8396-4189-b352-e5d81f386220 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:04.469515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a1467-cfdc-4919-a8b0-ac24da1bf471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:04.470302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a1467-cfdc-4919-a8b0-ac24da1bf471 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.470674 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a1467-cfdc-4919-a8b0-ac24da1bf471 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.471039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a1467-cfdc-4919-a8b0-ac24da1bf471 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.547487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a1467-cfdc-4919-a8b0-ac24da1bf471 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:04.549116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a1467-cfdc-4919-a8b0-ac24da1bf471 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:04.566929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6663f6-d1df-4fb6-b535-cce83ad7f3c9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:04.619701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3381-ab8d-49f6-9fa5-2ea9efd48054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:04.620902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3381-ab8d-49f6-9fa5-2ea9efd48054 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.621325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3381-ab8d-49f6-9fa5-2ea9efd48054 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.622013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3381-ab8d-49f6-9fa5-2ea9efd48054 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.623711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3381-ab8d-49f6-9fa5-2ea9efd48054 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:04.625287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3381-ab8d-49f6-9fa5-2ea9efd48054 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:04.649412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:04.655195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 490/971] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:25:04 2022] POST /identity/v3/endpoints => generated 349 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:04.662117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 482/972] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:04 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 03:25:04.668925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3381-ab8d-49f6-9fa5-2ea9efd48054 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:04.684494 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:04.801829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8ba0-a034-4c56-8fe7-ba754a7f9eb8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.801829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8ba0-a034-4c56-8fe7-ba754a7f9eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.801829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec8ba0-a034-4c56-8fe7-ba754a7f9eb8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.802949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 483/973] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:25:04.806321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3381-ab8d-49f6-9fa5-2ea9efd48054 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:04.811335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251a25-b1b2-47c6-9043-788807b6fdcf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.811626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251a25-b1b2-47c6-9043-788807b6fdcf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.811897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0251a25-b1b2-47c6-9043-788807b6fdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.834214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c0251a25-b1b2-47c6-9043-788807b6fdcf None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:04.836168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c0251a25-b1b2-47c6-9043-788807b6fdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:04.843784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:04.844696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:04.844975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:04.845243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:04.860030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:04.861504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:04.882573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:04.883613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:04.884555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:04.884555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:04.884555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:04.884555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 491/974] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:04.890313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:04.929081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 484/975] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:25:05.002215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:05.007374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecbeec-59d5-41fd-ad37-5ea87a6aba8b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:05.043058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:05.044059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.044481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.044890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.045710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:05.046173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:05.047703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:05.060157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 492/976] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:05.066891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251a25-b1b2-47c6-9043-788807b6fdcf None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:05.169386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0251a25-b1b2-47c6-9043-788807b6fdcf None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:05.194437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:05.206719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:05.207245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:05.207479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.207694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.207959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.216834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:05.218448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:25:05.230200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:05.231213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:05.232116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 485/977] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:05.237349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:05.318763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ee069-d3ba-400e-a545-eb1c7ecdef82 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:05.338328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeca28d-0ed9-4adc-92b1-717e3ff94400 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:05.352900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:05.357463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:05.358586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.359075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.359531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.360365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:05.362215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:05.365482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING keystone.server.flask.common [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 17 03:25:05.378075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:05.378719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.379006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.379369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.380187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:05.380491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:05.381707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.sql.core [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 03:25:05.381707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 03:25:05.381707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [parameters: {'user_id': 'ccfd8507196c43ab941a6ddb72cbeac6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 03:25:05.381707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81409) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 03:25:05.382161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:05.400602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 486/978] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application conn.query(q) Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result.read() Sep 17 03:25:05.401227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 03:25:05.402143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application next(self.gen) Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application yield resource Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application next(self.gen) Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise self.value Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application session.commit() Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 03:25:05.403114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.session.flush() Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application compat.raise_( Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 03:25:05.404067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 03:25:05.405742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application conn.query(q) Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application result.read() Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 03:25:05.406655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ccfd8507196c43ab941a6ddb72cbeac6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:05.407616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 17 03:25:05.408426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 17 03:25:05.410919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 17 03:25:05.410919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 17 03:25:05.410919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 03:25:05.410919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 03:25:05.410919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 03:25:05.410919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:05.411782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:05.418967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 493/979] 10.222.0.48 () {60 vars in 1131 bytes} [Sat Sep 17 03:25:05 2022] POST /identity/v3/users => generated 160 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:25:05.420528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:05.449838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:05.507278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b501e-d5b3-43e0-a8d2-988a032e8d32 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:05.533421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05baf54a-d340-4197-a749-0a3ad46b83ac None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:05.540287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d751548-05d6-486b-84e5-5f6ef320d838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:05.540889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751548-05d6-486b-84e5-5f6ef320d838 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.541163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751548-05d6-486b-84e5-5f6ef320d838 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.541428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d751548-05d6-486b-84e5-5f6ef320d838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.542177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d751548-05d6-486b-84e5-5f6ef320d838 None admin] RBAC: Adding query filter params (role.id=266b7d0aa48a4b4f83f29fd5699aa155, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=e5757b587e93429bacdf4a1b7f17d00a) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:05.542479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d751548-05d6-486b-84e5-5f6ef320d838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:05.543940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d751548-05d6-486b-84e5-5f6ef320d838 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:05.549902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 487/980] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:05 2022] GET /identity/v3/role_assignments?user.id=e5757b587e93429bacdf4a1b7f17d00a&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=266b7d0aa48a4b4f83f29fd5699aa155 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:05.551174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0098c-0d03-4dce-82bd-975f5e75a6b7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.551448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0098c-0d03-4dce-82bd-975f5e75a6b7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.551712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d0098c-0d03-4dce-82bd-975f5e75a6b7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.553183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 488/981] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:05.559025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d380-d1b4-4c64-962b-1ea4d5d05b9f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.559301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d380-d1b4-4c64-962b-1ea4d5d05b9f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.559576 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163d380-d1b4-4c64-962b-1ea4d5d05b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.580838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d163d380-d1b4-4c64-962b-1ea4d5d05b9f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:05.582515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d163d380-d1b4-4c64-962b-1ea4d5d05b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:05.583774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:05.584743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.585169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.585613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.595449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:05.597433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:25:05.612878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:05.614183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 03:25:05.615444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:05.618463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 494/982] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:25:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:05.624439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:05.666387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 489/983] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:05.676253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:05.744025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b168005-8d17-4100-a96d-b1b09176658b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:05.777571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:05.778220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:05.778495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:05.778763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:05.779468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:05.779768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:05.781196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:05.820385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 495/984] 10.222.0.48 () {56 vars in 1101 bytes} [Sat Sep 17 03:25:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:05.944250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163d380-d1b4-4c64-962b-1ea4d5d05b9f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:05.991187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:06.057170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163d380-d1b4-4c64-962b-1ea4d5d05b9f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:06.092156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:06.092853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:06.093131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:06.093399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:06.094065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:06.095438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:06.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:06.105708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:06.106788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 490/985] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:25:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:06.112182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:06.207132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:06.214903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0180bbf9-cd85-4a6a-a202-a42a5f8526f7 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:06.249662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:06.250378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:06.250649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:06.250914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:06.251560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:06.251854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:06.253192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:06.258401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 496/986] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:25:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:06.264312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:06.363772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e17aa2-01cc-4b30-8ac7-82402f17c0fc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:06.365332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:06.400781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:06.401390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:06.401655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:06.401945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:06.402583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] RBAC: Adding query filter params (type=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:06.402879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:06.404235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:06.409427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 491/987] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:25:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:06.415256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:06.513982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e0d5e-7173-42b2-aa78-bbd0db360626 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:06.549778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72042d3f-cf3b-4cd7-9003-8f52f745a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:06.550394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72042d3f-cf3b-4cd7-9003-8f52f745a47e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:06.550659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72042d3f-cf3b-4cd7-9003-8f52f745a47e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:06.550922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72042d3f-cf3b-4cd7-9003-8f52f745a47e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:06.551609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72042d3f-cf3b-4cd7-9003-8f52f745a47e None admin] RBAC: Adding query filter params (interface=public, service_id=403522a9e5844422b71218561f999c75, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:06.551964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72042d3f-cf3b-4cd7-9003-8f52f745a47e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:06.553314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72042d3f-cf3b-4cd7-9003-8f52f745a47e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:06.558506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 497/988] 10.222.0.48 () {56 vars in 1251 bytes} [Sat Sep 17 03:25:06 2022] GET /identity/v3/endpoints?service_id=403522a9e5844422b71218561f999c75&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:06.564097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:06.666089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d6804-7056-4e91-928a-e4fa38bc2cbc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:06.699604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77577c-3b0a-4dbf-a5ec-1635d2b64a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:06.700213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77577c-3b0a-4dbf-a5ec-1635d2b64a48 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:06.700485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77577c-3b0a-4dbf-a5ec-1635d2b64a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:06.700751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77577c-3b0a-4dbf-a5ec-1635d2b64a48 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:06.701345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77577c-3b0a-4dbf-a5ec-1635d2b64a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:06.702839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77577c-3b0a-4dbf-a5ec-1635d2b64a48 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:06.709128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 492/989] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:25:06 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:25:06.945233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c6fd-bc07-47d6-9b72-cd457aea5b45 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:06.945634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c6fd-bc07-47d6-9b72-cd457aea5b45 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:06.945801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9c6fd-bc07-47d6-9b72-cd457aea5b45 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:06.947242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 498/990] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:06.952770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5f00-c234-4987-9ccd-704815274a67 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:06.953042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5f00-c234-4987-9ccd-704815274a67 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:06.953340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca5f00-c234-4987-9ccd-704815274a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:06.971509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-40ca5f00-c234-4987-9ccd-704815274a67 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:06.972696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-40ca5f00-c234-4987-9ccd-704815274a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:07.000515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:07.049796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 493/991] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:07.311078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c6fd-bc07-47d6-9b72-cd457aea5b45 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:07.335866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:07.413381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9c6fd-bc07-47d6-9b72-cd457aea5b45 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:07.448158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:07.448792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:07.449066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:07.449333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:07.449946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:07.451316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:07.460510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:07.461538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:07.462439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:07.466120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 499/992] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:25:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:07.467808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca5f00-c234-4987-9ccd-704815274a67 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:07.571004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca5f00-c234-4987-9ccd-704815274a67 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:07.608460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d2f46-36e5-4062-8a34-e0291b00cddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:07.609082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d2f46-36e5-4062-8a34-e0291b00cddc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:07.609359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d2f46-36e5-4062-8a34-e0291b00cddc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:07.609627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d2f46-36e5-4062-8a34-e0291b00cddc None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:07.610291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d2f46-36e5-4062-8a34-e0291b00cddc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:07.610582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d2f46-36e5-4062-8a34-e0291b00cddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:07.611959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d2f46-36e5-4062-8a34-e0291b00cddc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:07.616994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 494/993] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:25:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:07.623090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:07.719545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:07.733679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32999b25-ba5f-448e-a37b-708687f526c6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:07.768494 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:07.769107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:07.769379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:07.769652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:07.770320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:07.770741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:07.772500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:07.777533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 500/994] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:25:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:07.782937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7f52-9bf5-4f37-a4e0-8a9d115da56e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:07.783230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7f52-9bf5-4f37-a4e0-8a9d115da56e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:07.783447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:07.783586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7f52-9bf5-4f37-a4e0-8a9d115da56e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:07.784932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 495/995] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:07.789692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443e3a-abda-46fa-8fd8-2d4c9f090ed4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:07.789997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443e3a-abda-46fa-8fd8-2d4c9f090ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:07.790270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28443e3a-abda-46fa-8fd8-2d4c9f090ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:07.808117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-28443e3a-abda-46fa-8fd8-2d4c9f090ed4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:07.809296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-28443e3a-abda-46fa-8fd8-2d4c9f090ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:07.828243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:07.880849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 496/996] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:25:07.889974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc1a79-e469-4ce0-a098-0b8841d2add0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:07.927302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:07.927908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:07.928180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:07.928445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:07.929145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] RBAC: Adding query filter params (interface=admin, service_id=2a8719ab78464aab96a9c399a42f3e08, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:07.929449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:07.930856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:07.940685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 501/997] 10.222.0.48 () {56 vars in 1249 bytes} [Sat Sep 17 03:25:07 2022] GET /identity/v3/endpoints?service_id=2a8719ab78464aab96a9c399a42f3e08&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:07.941812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28443e3a-abda-46fa-8fd8-2d4c9f090ed4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:08.049325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28443e3a-abda-46fa-8fd8-2d4c9f090ed4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:08.083433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32bf69-2f9a-4f60-8696-a1f9bd28c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:08.083970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32bf69-2f9a-4f60-8696-a1f9bd28c69d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:08.084246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32bf69-2f9a-4f60-8696-a1f9bd28c69d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:08.084510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32bf69-2f9a-4f60-8696-a1f9bd28c69d None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:08.085105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32bf69-2f9a-4f60-8696-a1f9bd28c69d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:08.086501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32bf69-2f9a-4f60-8696-a1f9bd28c69d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:08.101788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 497/998] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:25:07 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:25:08.147683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:08.167952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:08.258360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cc372e-c635-4387-aa89-ce2042d94d2f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:08.296572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:08.297211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:08.297485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:08.297770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:08.298365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:08.299723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:08.308716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:08.309738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:08.311043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 502/999] 10.222.0.48 () {56 vars in 1105 bytes} [Sat Sep 17 03:25:08 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:08.315693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32bf69-2f9a-4f60-8696-a1f9bd28c69d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:08.335851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:08.418569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32bf69-2f9a-4f60-8696-a1f9bd28c69d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:08.452359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934cdd-e822-470f-8a4a-cbae72af79c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:08.452966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934cdd-e822-470f-8a4a-cbae72af79c9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:08.453247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934cdd-e822-470f-8a4a-cbae72af79c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:08.453502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934cdd-e822-470f-8a4a-cbae72af79c9 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:08.454171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934cdd-e822-470f-8a4a-cbae72af79c9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:08.454448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934cdd-e822-470f-8a4a-cbae72af79c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:08.455806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934cdd-e822-470f-8a4a-cbae72af79c9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:08.460784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 498/1000] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:08.466467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:08.551056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:08.571814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea46643-9999-45fa-933a-567860c93ee6 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:08.606162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48839ab5-9667-4699-b0d8-b7327cc64fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:08.606794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839ab5-9667-4699-b0d8-b7327cc64fee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:08.607066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839ab5-9667-4699-b0d8-b7327cc64fee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:08.607332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48839ab5-9667-4699-b0d8-b7327cc64fee None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:08.607965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48839ab5-9667-4699-b0d8-b7327cc64fee None admin] RBAC: Adding query filter params (type=image) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:08.608286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48839ab5-9667-4699-b0d8-b7327cc64fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:08.609650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48839ab5-9667-4699-b0d8-b7327cc64fee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:08.614312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 503/1001] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:08.868476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f214e-341e-402b-9a6f-28bad2aad8eb None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:08.868991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f214e-341e-402b-9a6f-28bad2aad8eb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:08.868991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f214e-341e-402b-9a6f-28bad2aad8eb None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:08.870478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 499/1002] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:08.875670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0acd6-f5b6-4183-9108-43b095ee5a8e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:08.875961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0acd6-f5b6-4183-9108-43b095ee5a8e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:08.876216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0acd6-f5b6-4183-9108-43b095ee5a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:08.895454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-41f0acd6-f5b6-4183-9108-43b095ee5a8e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:08.897063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-41f0acd6-f5b6-4183-9108-43b095ee5a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:08.967290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 504/1003] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:09.232271 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f214e-341e-402b-9a6f-28bad2aad8eb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:09.325384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:09.346063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f214e-341e-402b-9a6f-28bad2aad8eb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:09.380508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:09.381132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:09.381401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:09.381667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:09.382320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:09.383756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:09.393099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:09.394162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:09.398858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 500/1004] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:25:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:09.400832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0acd6-f5b6-4183-9108-43b095ee5a8e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:09.478085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:09.506587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0acd6-f5b6-4183-9108-43b095ee5a8e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:09.540585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:09.541195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:09.541475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:09.541743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:09.542415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:09.542714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:09.544072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:09.549066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 505/1005] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:25:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:09.554689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:09.654305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af428d-777a-4eef-80f2-4b3b53a2ab46 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:09.688202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18701e-d580-4d40-934a-594f4e69d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:09.688817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18701e-d580-4d40-934a-594f4e69d795 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:09.689093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18701e-d580-4d40-934a-594f4e69d795 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:09.689361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18701e-d580-4d40-934a-594f4e69d795 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:09.690019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18701e-d580-4d40-934a-594f4e69d795 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:09.690326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18701e-d580-4d40-934a-594f4e69d795 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:09.691696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18701e-d580-4d40-934a-594f4e69d795 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:09.696644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 501/1006] 10.222.0.48 () {56 vars in 1112 bytes} [Sat Sep 17 03:25:09 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:09.702214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:09.805408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2599c7-9f56-4228-8b10-4899d4e22488 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:09.840778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afec531-f526-4058-bf3d-a0a9987bf60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:09.841794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec531-f526-4058-bf3d-a0a9987bf60a None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:09.842269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec531-f526-4058-bf3d-a0a9987bf60a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:09.842726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec531-f526-4058-bf3d-a0a9987bf60a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:09.843602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afec531-f526-4058-bf3d-a0a9987bf60a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:09.845314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afec531-f526-4058-bf3d-a0a9987bf60a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:09.854666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:09.868403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 506/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:25:09 2022] POST /identity/v3/endpoints => generated 334 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:10.257877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80257622-603e-48e1-8fb6-7a5d0378ea26 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:10.258401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80257622-603e-48e1-8fb6-7a5d0378ea26 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:10.258401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80257622-603e-48e1-8fb6-7a5d0378ea26 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:10.259905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 502/1008] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:10.265354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a43db-cf69-4dad-bd65-48995a242bf3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:10.265642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a43db-cf69-4dad-bd65-48995a242bf3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:10.265955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a43db-cf69-4dad-bd65-48995a242bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:10.285932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-185a43db-cf69-4dad-bd65-48995a242bf3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:10.287151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-185a43db-cf69-4dad-bd65-48995a242bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:10.361021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 507/1009] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:10 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:10.626868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80257622-603e-48e1-8fb6-7a5d0378ea26 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:10.641381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:10.736875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80257622-603e-48e1-8fb6-7a5d0378ea26 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:10.771547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:10.772182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:10.772452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:10.772706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:10.773289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:10.774689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:10.778846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70680-47fd-4918-9f18-6fde2c9b573e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:10.779305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70680-47fd-4918-9f18-6fde2c9b573e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:10.779381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca70680-47fd-4918-9f18-6fde2c9b573e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:10.780860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 508/1010] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:10.783891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:10.784881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:10.785769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 503/1011] 10.222.0.48 () {56 vars in 1126 bytes} [Sat Sep 17 03:25:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:10.788270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee451-72a7-4b19-a96a-7ab1594c4c28 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:10.788544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee451-72a7-4b19-a96a-7ab1594c4c28 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:10.788806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee451-72a7-4b19-a96a-7ab1594c4c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:10.790816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:10.808529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a16ee451-72a7-4b19-a96a-7ab1594c4c28 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:10.809714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a16ee451-72a7-4b19-a96a-7ab1594c4c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:10.867095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:10.882391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 509/1012] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:10 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:25:10.899864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893d7c00-2d52-4960-bea1-e829416d1708 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:10.934857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:10.935465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:10.935740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:10.936010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:10.936635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:10.936967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:10.938397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:10.943542 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 504/1013] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:25:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:10.949327 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee451-72a7-4b19-a96a-7ab1594c4c28 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:11.004898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:11.056631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee451-72a7-4b19-a96a-7ab1594c4c28 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:11.090033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:11.090639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:11.090915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:11.091180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:11.091805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:11.092105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:11.093491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:11.101974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 510/1014] 10.222.0.48 () {56 vars in 1122 bytes} [Sat Sep 17 03:25:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:11.104470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:11.143184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:11.212127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4c0d9-d832-4922-bd8f-275354ba98ca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:11.246861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013b43e-af03-4c05-b18d-94f872998ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:11.247753 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704b67-2262-4a22-949f-3a8361a3c831 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:11.248066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b43e-af03-4c05-b18d-94f872998ec3 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:11.248537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b43e-af03-4c05-b18d-94f872998ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:11.249208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013b43e-af03-4c05-b18d-94f872998ec3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:11.250245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013b43e-af03-4c05-b18d-94f872998ec3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:11.251711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f013b43e-af03-4c05-b18d-94f872998ec3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:11.262778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:11.265431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:11.282663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 505/1015] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:25:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:11.303178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd564b-c0e7-4443-84dc-8f4c8c7b7ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:11.303806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd564b-c0e7-4443-84dc-8f4c8c7b7ffa None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:11.304083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd564b-c0e7-4443-84dc-8f4c8c7b7ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:11.304349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd564b-c0e7-4443-84dc-8f4c8c7b7ffa None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:11.305008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd564b-c0e7-4443-84dc-8f4c8c7b7ffa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:11.306507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd564b-c0e7-4443-84dc-8f4c8c7b7ffa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:11.324380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 511/1016] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:25:11 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:12.128687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebfe5-8300-413f-bcee-0d9ca0aacc67 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:12.129040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebfe5-8300-413f-bcee-0d9ca0aacc67 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:12.129243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebfe5-8300-413f-bcee-0d9ca0aacc67 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:12.130768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 506/1017] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:12.136611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfeea3-006e-4968-a9d2-e409299956b4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:12.137075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfeea3-006e-4968-a9d2-e409299956b4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:12.137164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfeea3-006e-4968-a9d2-e409299956b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:12.156037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-71bfeea3-006e-4968-a9d2-e409299956b4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:12.157255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-71bfeea3-006e-4968-a9d2-e409299956b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:12.237511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 512/1018] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:12.502606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bebfe5-8300-413f-bcee-0d9ca0aacc67 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:12.610659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bebfe5-8300-413f-bcee-0d9ca0aacc67 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:12.645467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1261-fb21-4e5e-9242-eafdcf4d9bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:12.646141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1261-fb21-4e5e-9242-eafdcf4d9bdb None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:12.646414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1261-fb21-4e5e-9242-eafdcf4d9bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:12.646678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef1261-fb21-4e5e-9242-eafdcf4d9bdb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:12.656614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef1261-fb21-4e5e-9242-eafdcf4d9bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e0ef1261-fb21-4e5e-9242-eafdcf4d9bdb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:12.661358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:12.662327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:12.663208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 507/1019] 10.222.0.48 () {56 vars in 1120 bytes} [Sat Sep 17 03:25:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:12.670132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfeea3-006e-4968-a9d2-e409299956b4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:12.761359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:12.768942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfeea3-006e-4968-a9d2-e409299956b4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:12.803218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:12.804107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:12.804644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:12.805102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:12.806062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:12.806574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:12.808135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:12.816853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 513/1020] 10.222.0.48 () {56 vars in 1115 bytes} [Sat Sep 17 03:25:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:12.823119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1261-fb21-4e5e-9242-eafdcf4d9bdb None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:12.884567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:12.928723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef1261-fb21-4e5e-9242-eafdcf4d9bdb None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:12.964135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:12.964770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:12.965043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:12.965314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:12.975682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:12.979044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:12.996069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:12.997112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:12.998081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:12.998081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:12.998081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:12.998969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 508/1021] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:13.003113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:13.109863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acec84e-faf9-4212-b754-f971e654fa07 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:13.144322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:13.144955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.145197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.145469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.146147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:13.146442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:13.147793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:13.159725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 514/1022] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:13.165567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:13.268160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f18745-db50-4735-b5c5-e5635b682441 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:13.279033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:13.306270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e53780-a8a3-4935-a1fb-c23c32e35d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:13.306917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53780-a8a3-4935-a1fb-c23c32e35d2f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.307196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53780-a8a3-4935-a1fb-c23c32e35d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.307469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e53780-a8a3-4935-a1fb-c23c32e35d2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.316120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53780-a8a3-4935-a1fb-c23c32e35d2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:13.317638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e53780-a8a3-4935-a1fb-c23c32e35d2f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-69e53780-a8a3-4935-a1fb-c23c32e35d2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:25:13.330660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:13.331717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:13.338063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 509/1023] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:25:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:13.340675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:13.364379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:13.443332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9fc84-1246-4a15-99c0-014439101d46 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.443618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9fc84-1246-4a15-99c0-014439101d46 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.443896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9fc84-1246-4a15-99c0-014439101d46 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.445261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 510/1024] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:13.450467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509a0e-f685-4ddf-b9e3-3737ab14ab5c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.451000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509a0e-f685-4ddf-b9e3-3737ab14ab5c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.451481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3509a0e-f685-4ddf-b9e3-3737ab14ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.454748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03217315-371b-4c13-9b7c-2e56e9b6ada9 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:13.470508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b3509a0e-f685-4ddf-b9e3-3737ab14ab5c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:13.471687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b3509a0e-f685-4ddf-b9e3-3737ab14ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:13.490319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803b573-7a5f-49bf-8df0-3feaa7f886ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:13.490933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803b573-7a5f-49bf-8df0-3feaa7f886ee None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.491207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803b573-7a5f-49bf-8df0-3feaa7f886ee None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.491472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803b573-7a5f-49bf-8df0-3feaa7f886ee None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.492192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803b573-7a5f-49bf-8df0-3feaa7f886ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:13.492491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803b573-7a5f-49bf-8df0-3feaa7f886ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:13.493950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803b573-7a5f-49bf-8df0-3feaa7f886ee None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:13.511151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 515/1025] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:25:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:13.512352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa181e-8c1b-4beb-887c-6a4cc01a2814 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.512633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa181e-8c1b-4beb-887c-6a4cc01a2814 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.512902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa181e-8c1b-4beb-887c-6a4cc01a2814 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.514108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 516/1026] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:13.516881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa181e-8c1b-4beb-887c-6a4cc01a2814 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:13.542463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 511/1027] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:25:13.543703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538798-a035-4a9e-8607-cbc22b2a1e2d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.543959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538798-a035-4a9e-8607-cbc22b2a1e2d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.544246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538798-a035-4a9e-8607-cbc22b2a1e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.561860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e1538798-a035-4a9e-8607-cbc22b2a1e2d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:13.563031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e1538798-a035-4a9e-8607-cbc22b2a1e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:13.596080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:13.622316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa181e-8c1b-4beb-887c-6a4cc01a2814 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:13.628041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 512/1028] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:13.655694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf378f0-b75b-461d-9023-a1e82839f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:13.656304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf378f0-b75b-461d-9023-a1e82839f5ff None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.656579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf378f0-b75b-461d-9023-a1e82839f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.656848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf378f0-b75b-461d-9023-a1e82839f5ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.722869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf378f0-b75b-461d-9023-a1e82839f5ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:13.724398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf378f0-b75b-461d-9023-a1e82839f5ff None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:13.796686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:13.804617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538798-a035-4a9e-8607-cbc22b2a1e2d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:13.826613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 517/1029] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:13 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 03:25:13.832469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf378f0-b75b-461d-9023-a1e82839f5ff None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:13.835027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:13.909793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538798-a035-4a9e-8607-cbc22b2a1e2d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:13.940132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf378f0-b75b-461d-9023-a1e82839f5ff None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:13.944028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec025-2d43-439b-bb90-2cd46bd9921d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:13.944657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec025-2d43-439b-bb90-2cd46bd9921d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.944930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec025-2d43-439b-bb90-2cd46bd9921d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.945195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cec025-2d43-439b-bb90-2cd46bd9921d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:13.946380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cec025-2d43-439b-bb90-2cd46bd9921d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:13.947817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cec025-2d43-439b-bb90-2cd46bd9921d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:13.949393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 513/1030] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:13.950225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec025-2d43-439b-bb90-2cd46bd9921d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:13.995988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:13.996634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:13.996911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:13.997181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.007288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.008738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:14.023323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:14.024361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:14.025637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:14.025637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:14.025637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:14.025637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 518/1031] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:25:14.025637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.055671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:14.057559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:14.061954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cec025-2d43-439b-bb90-2cd46bd9921d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.094273 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.094899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.095170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.095435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] PATH_INFO: `/v3/services/image` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.096004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.097358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:14.105844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:14.106841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:14.107746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 514/1032] 10.222.0.48 () {56 vars in 1105 bytes} [Sat Sep 17 03:25:13 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:14.108569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.128107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d73378-5769-47eb-aef2-6c13f82293dd None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.161830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bba1c7-e4ae-4d1f-8c7f-5659083d71c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.162424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba1c7-e4ae-4d1f-8c7f-5659083d71c1 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.162640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba1c7-e4ae-4d1f-8c7f-5659083d71c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.162907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bba1c7-e4ae-4d1f-8c7f-5659083d71c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.163553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bba1c7-e4ae-4d1f-8c7f-5659083d71c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.164998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bba1c7-e4ae-4d1f-8c7f-5659083d71c1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.193895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 519/1033] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:25:14 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:14.195092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bba1c7-e4ae-4d1f-8c7f-5659083d71c1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.212808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f25a07b-93af-4085-912f-bee966ee46c4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.250461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.251094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.251376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.251640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.252333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:14.252635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.254112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.267134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 515/1034] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:14.273161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.291284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:14.302677 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:14.318162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bba1c7-e4ae-4d1f-8c7f-5659083d71c1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.356603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.357224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.357498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.357784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.358444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] RBAC: Adding query filter params (name=image) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:14.358743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.360137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.365607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 520/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:14.371427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.399874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ae801-b27c-4cfa-bc24-cee9e5a8c91d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.438980 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.439532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.439805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.440070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.447009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.448453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:25:14.459868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:14.460974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:14.462077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 516/1036] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:25:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:25:14.466954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.485012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ccc29-86c6-4610-8872-69d6e6a2cf8a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.521421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.522061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.522334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.522601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.523226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] RBAC: Adding query filter params (type=image) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:14.523520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.524878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.530172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 521/1037] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:14.536450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.547225 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:14.556222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:14.576316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d94a0-2007-433c-9fe7-c4560a793f28 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.610019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.610669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.610937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.611234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.611933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:14.612255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.613703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.626376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 517/1038] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:25:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:14.632808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.644033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0a8fa-4611-48ad-b5ef-2795a5cb6f4a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.680388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.681009 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.681723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.682033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.682744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] RBAC: Adding query filter params (interface=public, service_id=b2eb57dc148f438294763ec7db524478, region_id=RegionOne) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:14.683053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.685093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.691113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 522/1039] 10.222.0.48 () {56 vars in 1251 bytes} [Sat Sep 17 03:25:14 2022] GET /identity/v3/endpoints?service_id=b2eb57dc148f438294763ec7db524478&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:14.698103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:14.748957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274f3d1-b8a3-41d6-be9e-4078b1febde3 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.773666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:14.785066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72765541-accd-46d0-890e-f8e57ff3c780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.785685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72765541-accd-46d0-890e-f8e57ff3c780 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.786064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72765541-accd-46d0-890e-f8e57ff3c780 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.786353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72765541-accd-46d0-890e-f8e57ff3c780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.787071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72765541-accd-46d0-890e-f8e57ff3c780 None admin] RBAC: Adding query filter params (role.id=266b7d0aa48a4b4f83f29fd5699aa155, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=fda0f612b2ec42b2beac9af0b49ccff0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:14.787383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72765541-accd-46d0-890e-f8e57ff3c780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.788860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72765541-accd-46d0-890e-f8e57ff3c780 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.794619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 518/1040] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:14 2022] GET /identity/v3/role_assignments?user.id=fda0f612b2ec42b2beac9af0b49ccff0&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=266b7d0aa48a4b4f83f29fd5699aa155 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:14.807388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dea3f-1de2-4516-a71f-339c75db38e1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:14.846663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a194a-0672-4ed0-a33a-7bfef55795df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:14.847289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a194a-0672-4ed0-a33a-7bfef55795df None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:14.847561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a194a-0672-4ed0-a33a-7bfef55795df None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:14.847829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a194a-0672-4ed0-a33a-7bfef55795df None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:14.848530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a194a-0672-4ed0-a33a-7bfef55795df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:14.849929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a194a-0672-4ed0-a33a-7bfef55795df None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:14.857683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 523/1041] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:25:14 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:25:16.365640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66b08-aba8-4388-86c1-2aae531ca34c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:16.366195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66b08-aba8-4388-86c1-2aae531ca34c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:16.366195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66b08-aba8-4388-86c1-2aae531ca34c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:16.367620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 519/1042] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:16.372983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291278-539a-4c02-ba06-9a6a36bb82b6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:16.373434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291278-539a-4c02-ba06-9a6a36bb82b6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:16.373516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a291278-539a-4c02-ba06-9a6a36bb82b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:16.392969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3a291278-539a-4c02-ba06-9a6a36bb82b6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:16.394201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3a291278-539a-4c02-ba06-9a6a36bb82b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:16.465037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 524/1043] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:16.730033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66b08-aba8-4388-86c1-2aae531ca34c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:16.739527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:16.845215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66b08-aba8-4388-86c1-2aae531ca34c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:16.880819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7d595-6407-4b91-8107-a917c0b2314c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:16.881509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d595-6407-4b91-8107-a917c0b2314c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:16.881782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d595-6407-4b91-8107-a917c0b2314c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:16.882073 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7d595-6407-4b91-8107-a917c0b2314c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:16.883175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7d595-6407-4b91-8107-a917c0b2314c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:16.884624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7d595-6407-4b91-8107-a917c0b2314c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:16.886780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 520/1044] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:16.892607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291278-539a-4c02-ba06-9a6a36bb82b6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:16.920815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad3a8-743e-4d84-8837-5fa4159d770c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:16.921115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad3a8-743e-4d84-8837-5fa4159d770c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:16.921356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad3a8-743e-4d84-8837-5fa4159d770c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:16.923081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 521/1045] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:25:16.927842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba947d1-61d6-4085-a8ea-b84bd19c7b02 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:16.928122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba947d1-61d6-4085-a8ea-b84bd19c7b02 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:16.928390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba947d1-61d6-4085-a8ea-b84bd19c7b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:16.949883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6ba947d1-61d6-4085-a8ea-b84bd19c7b02 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:16.951444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6ba947d1-61d6-4085-a8ea-b84bd19c7b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:16.966179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:17.011087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a291278-539a-4c02-ba06-9a6a36bb82b6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:17.025595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 522/1046] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:16 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:25:17.048286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab37a-ad10-4249-a37d-a56f9d67bcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:17.049132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab37a-ad10-4249-a37d-a56f9d67bcd1 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.049583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab37a-ad10-4249-a37d-a56f9d67bcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.050031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ab37a-ad10-4249-a37d-a56f9d67bcd1 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.050822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab37a-ad10-4249-a37d-a56f9d67bcd1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:17.052467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ab37a-ad10-4249-a37d-a56f9d67bcd1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:17.065005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312f39-6fe0-499a-95ec-8b2241a8b187 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.065287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312f39-6fe0-499a-95ec-8b2241a8b187 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.065568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0312f39-6fe0-499a-95ec-8b2241a8b187 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.066976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 523/1047] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:17.072443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d8df-0ec6-4e57-8d52-093cb689a0b7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.072700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d8df-0ec6-4e57-8d52-093cb689a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.073033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d8df-0ec6-4e57-8d52-093cb689a0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.081788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 525/1048] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:25:16 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:17.081996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:17.095042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-97b2d8df-0ec6-4e57-8d52-093cb689a0b7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:17.096276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-97b2d8df-0ec6-4e57-8d52-093cb689a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:17.172514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 524/1049] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:25:17.292453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab37a-ad10-4249-a37d-a56f9d67bcd1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:17.396149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ab37a-ad10-4249-a37d-a56f9d67bcd1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:17.418766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:17.432876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c892cae-285c-4fbf-910b-0086718a036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:17.433517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c892cae-285c-4fbf-910b-0086718a036d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.433813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c892cae-285c-4fbf-910b-0086718a036d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.433916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d8df-0ec6-4e57-8d52-093cb689a0b7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:17.434328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c892cae-285c-4fbf-910b-0086718a036d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.445241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c892cae-285c-4fbf-910b-0086718a036d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-1c892cae-285c-4fbf-910b-0086718a036d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:17.449948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:17.450900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:17.451771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 526/1050] 10.222.0.48 () {56 vars in 1120 bytes} [Sat Sep 17 03:25:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:17.457045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c892cae-285c-4fbf-910b-0086718a036d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:17.536133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d8df-0ec6-4e57-8d52-093cb689a0b7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:17.569433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c892cae-285c-4fbf-910b-0086718a036d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:17.571762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:17.572387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.572651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.572924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] PATH_INFO: `/v3/services/image` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.573510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:17.574915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:17.577183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:17.585873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:17.586924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 03:25:17.587797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:17.590657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 525/1051] 10.222.0.48 () {56 vars in 1105 bytes} [Sat Sep 17 03:25:17 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:25:17.596218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:17.612148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:17.612796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.613061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.613333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.614117 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:17.614343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:17.615727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:17.624272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 527/1052] 10.222.0.48 () {56 vars in 1115 bytes} [Sat Sep 17 03:25:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:17.629782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:17.681084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:17.703962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9046c72-93c5-433c-9981-e805c5b44563 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:17.738601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f8142-e685-4aa6-9dd0-f61167b33b74 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:17.740531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:17.741145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.741470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.741738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.742402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] RBAC: Adding query filter params (name=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:17.742709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:17.744164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:17.749043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 526/1053] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:17.754689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:17.781670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:17.782328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.782596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.782858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.794806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:17.796280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:17.811078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:17.812262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:17.818193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:17.818193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:17.818193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:17.818193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 528/1054] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:25:17.818193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:17.824175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:17.863190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce448579-6b3e-4c8c-bdd1-65f0f0b82f7f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:17.896755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:17.897485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.897851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.898165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.898879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] RBAC: Adding query filter params (type=image) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:17.899244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:17.900682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:17.910278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 527/1055] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:17 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:17.911287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:17.922379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:17.930462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca1fbb-f8c1-4318-ac55-d8e1bf5485fe None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:17.968073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:17.968689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:17.968965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:17.969229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:17.969906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:17.970206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:17.971571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:17.984699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 529/1056] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:17.990382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:18.023409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bcd7d8-9517-4a66-97e7-8c612d501367 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:18.050208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:18.060149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3e98-f2a4-4618-8d82-39f80c2b50e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:18.060726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3e98-f2a4-4618-8d82-39f80c2b50e5 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:18.061002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3e98-f2a4-4618-8d82-39f80c2b50e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:18.061268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3e98-f2a4-4618-8d82-39f80c2b50e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:18.061954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a3e98-f2a4-4618-8d82-39f80c2b50e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:18.063329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a3e98-f2a4-4618-8d82-39f80c2b50e5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:18.083960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 528/1057] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:25:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:18.107136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a0f31f-64c6-4ea9-be3f-71ed89476f14 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:18.153551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:18.154222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:18.154496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:18.154763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:18.163155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:18.164630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:25:18.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:18.178789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:18.184765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 530/1058] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:25:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:18.187285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3e98-f2a4-4618-8d82-39f80c2b50e5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:18.297365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3e98-f2a4-4618-8d82-39f80c2b50e5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:18.331150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:18.331762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:18.332040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:18.332309 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:18.333072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:18.333375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:18.334896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:18.352962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 529/1059] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:25:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:18.358759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:18.374438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:18.462815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da872b-f20c-4e67-9058-56ed04a17844 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:18.497231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:18.497880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:18.498154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:18.498410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:18.509125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:18.510945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:18.525039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:18.526270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:18.527222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:18.527222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:18.527222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:18.527222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 531/1060] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:18.533778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:18.577575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:18.638701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7ad51-1e69-477a-9a7c-d0d6d2ada3ad None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:18.673354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:18.673993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:18.674247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:18.674530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:18.675162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:18.675711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:18.677360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:18.689665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 530/1061] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:18.695220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:18.758248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:18.798488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574097b0-c280-43d1-9891-b471333509f8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:18.834489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:18.835125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:18.835397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:18.835661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:18.842775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:18.844217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:25:18.856463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:18.857468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:18.858420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:25:18.858420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:25:18.858420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:25:18.858420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:25:18.858420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:25:18.858420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:25:18.858420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:18.858420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:18.859585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 532/1062] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:25:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:18.863672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:18.964539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:18.968381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa920088-8015-4adf-be91-64fa14050f6d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:19.016346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9fc7d-c014-488e-900e-9bd668aba2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:19.016970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9fc7d-c014-488e-900e-9bd668aba2ec None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:19.017250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9fc7d-c014-488e-900e-9bd668aba2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:19.017518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9fc7d-c014-488e-900e-9bd668aba2ec None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:19.018330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9fc7d-c014-488e-900e-9bd668aba2ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:19.018638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9fc7d-c014-488e-900e-9bd668aba2ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:19.020083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9fc7d-c014-488e-900e-9bd668aba2ec None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:19.037838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 531/1063] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:25:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:19.039493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:19.140751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989787-cd3b-4b4c-85c1-4a2372b708a0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:19.164093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:19.176668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c38a3d-55f5-4e4c-8afb-b2a2e770062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:19.177337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c38a3d-55f5-4e4c-8afb-b2a2e770062b None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:19.177629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c38a3d-55f5-4e4c-8afb-b2a2e770062b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:19.177939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c38a3d-55f5-4e4c-8afb-b2a2e770062b None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/fda0f612b2ec42b2beac9af0b49ccff0/roles/266b7d0aa48a4b4f83f29fd5699aa155` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:19.180252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c38a3d-55f5-4e4c-8afb-b2a2e770062b None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=fda0f612b2ec42b2beac9af0b49ccff0, role_id=266b7d0aa48a4b4f83f29fd5699aa155)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:19.181733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c38a3d-55f5-4e4c-8afb-b2a2e770062b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:19.197849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 533/1064] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:25:19 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/fda0f612b2ec42b2beac9af0b49ccff0/roles/266b7d0aa48a4b4f83f29fd5699aa155 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:25:19.307009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70c44-1bff-43e0-8163-b8e0b415ae47 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:19.307203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70c44-1bff-43e0-8163-b8e0b415ae47 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:19.307465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70c44-1bff-43e0-8163-b8e0b415ae47 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:19.308988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 532/1065] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:19.314796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735496-9937-47fa-abba-95f81671ce0c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:19.315086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735496-9937-47fa-abba-95f81671ce0c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:19.315362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22735496-9937-47fa-abba-95f81671ce0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:19.335355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-22735496-9937-47fa-abba-95f81671ce0c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:19.336691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-22735496-9937-47fa-abba-95f81671ce0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:19.412823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 534/1066] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:19.675491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70c44-1bff-43e0-8163-b8e0b415ae47 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:19.779913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70c44-1bff-43e0-8163-b8e0b415ae47 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:19.815581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4bba-2407-420f-b227-c9898f94a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:19.816591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4bba-2407-420f-b227-c9898f94a931 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:19.817144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4bba-2407-420f-b227-c9898f94a931 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:19.817609 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e4bba-2407-420f-b227-c9898f94a931 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:19.828215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e4bba-2407-420f-b227-c9898f94a931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-b82e4bba-2407-420f-b227-c9898f94a931 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:19.833263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:19.834246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:19.835170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:19.837809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 533/1067] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:25:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:19.842180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735496-9937-47fa-abba-95f81671ce0c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:19.951058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22735496-9937-47fa-abba-95f81671ce0c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:19.966449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:19.993121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:19.993740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:19.994042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:19.994308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:19.994969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:19.995320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:19.996721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:20.010252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 535/1068] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:25:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:20.011892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4bba-2407-420f-b227-c9898f94a931 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:20.035201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:20.120449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e4bba-2407-420f-b227-c9898f94a931 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:20.156114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2b8942-5eac-4a29-95da-4ed81e433324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:20.156777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b8942-5eac-4a29-95da-4ed81e433324 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:20.157055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b8942-5eac-4a29-95da-4ed81e433324 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:20.157402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2b8942-5eac-4a29-95da-4ed81e433324 None admin] PATH_INFO: `/v3/users/3bb6d1a1eac14cffa5748f7d018e0563` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:20.173983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b8942-5eac-4a29-95da-4ed81e433324 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb6d1a1eac14cffa5748f7d018e0563)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:20.175492 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2b8942-5eac-4a29-95da-4ed81e433324 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:20.182001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 534/1069] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:20 2022] GET /identity/v3/users/3bb6d1a1eac14cffa5748f7d018e0563 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:20.183762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:20.279872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a59c-aedd-41ab-a172-abd343c380cf None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:20.280132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a59c-aedd-41ab-a172-abd343c380cf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:20.280280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817a59c-aedd-41ab-a172-abd343c380cf None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:20.281628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 535/1070] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:25:20.287335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa956e-81d9-4f09-ab01-44d08e8695d1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:20.287689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa956e-81d9-4f09-ab01-44d08e8695d1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:20.288025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa956e-81d9-4f09-ab01-44d08e8695d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:20.298336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6383da3-7874-42aa-8437-af508fee30c5 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:20.308309 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-eeaa956e-81d9-4f09-ab01-44d08e8695d1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:20.309915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-eeaa956e-81d9-4f09-ab01-44d08e8695d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:20.332636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cc01a-5db2-46cd-b565-63f91742334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:20.333242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc01a-5db2-46cd-b565-63f91742334d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:20.333514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc01a-5db2-46cd-b565-63f91742334d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:20.333799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32cc01a-5db2-46cd-b565-63f91742334d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:20.378680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 536/1071] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:25:20.382931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:20.405543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cc01a-5db2-46cd-b565-63f91742334d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:20.407034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32cc01a-5db2-46cd-b565-63f91742334d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:20.503379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 536/1072] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:20.509238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa956e-81d9-4f09-ab01-44d08e8695d1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:20.520554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:20.613738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa956e-81d9-4f09-ab01-44d08e8695d1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:20.639969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cc01a-5db2-46cd-b565-63f91742334d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:20.651430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab9d88-3893-4e95-94d3-847434e98c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:20.652075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9d88-3893-4e95-94d3-847434e98c57 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:20.652706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9d88-3893-4e95-94d3-847434e98c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:20.652987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab9d88-3893-4e95-94d3-847434e98c57 None admin] PATH_INFO: `/v3/projects/ec7dbf621bef45caa8728298c76ec88c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:20.654575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab9d88-3893-4e95-94d3-847434e98c57 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7dbf621bef45caa8728298c76ec88c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:20.656021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab9d88-3893-4e95-94d3-847434e98c57 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:20.657986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 537/1073] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:20 2022] GET /identity/v3/projects/ec7dbf621bef45caa8728298c76ec88c => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:20.663958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab9d88-3893-4e95-94d3-847434e98c57 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:20.730493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:20.744165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:20.757679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32cc01a-5db2-46cd-b565-63f91742334d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:20.768860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab9d88-3893-4e95-94d3-847434e98c57 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:20.793613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a76e-3cb4-4aa2-8ab9-c13c9bd39c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:20.794272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a76e-3cb4-4aa2-8ab9-c13c9bd39c21 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:20.794553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a76e-3cb4-4aa2-8ab9-c13c9bd39c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:20.794818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025a76e-3cb4-4aa2-8ab9-c13c9bd39c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:20.803322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:20.803930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:20.804202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:20.804466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:20.805174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=ec7dbf621bef45caa8728298c76ec88c, user.id=3bb6d1a1eac14cffa5748f7d018e0563) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:20.805596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:20.807159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:20.813141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 538/1074] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:20 2022] GET /identity/v3/role_assignments?user.id=3bb6d1a1eac14cffa5748f7d018e0563&scope.project.id=ec7dbf621bef45caa8728298c76ec88c&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:20.876835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025a76e-3cb4-4aa2-8ab9-c13c9bd39c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:20.878989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025a76e-3cb4-4aa2-8ab9-c13c9bd39c21 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:20.964482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:20.995627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 537/1075] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:21.001466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:21.112420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33495a65-2a9a-4a6e-9284-eee3a38ae60a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:21.146494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8780447d-554e-458a-a1a5-5da3f366bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:21.147110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780447d-554e-458a-a1a5-5da3f366bd70 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:21.147381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780447d-554e-458a-a1a5-5da3f366bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:21.147653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8780447d-554e-458a-a1a5-5da3f366bd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:21.156373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:21.159198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780447d-554e-458a-a1a5-5da3f366bd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:21.161037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8780447d-554e-458a-a1a5-5da3f366bd70 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8780447d-554e-458a-a1a5-5da3f366bd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:21.175816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:21.176907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:21.178333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:21.178333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:21.178333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:21.178333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 539/1076] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:21.183071 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a76e-3cb4-4aa2-8ab9-c13c9bd39c21 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:21.285799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025a76e-3cb4-4aa2-8ab9-c13c9bd39c21 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:21.320686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc4b288-a90f-445a-aa4a-5a47c9270ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:21.321294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b288-a90f-445a-aa4a-5a47c9270ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:21.321562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b288-a90f-445a-aa4a-5a47c9270ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:21.321847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc4b288-a90f-445a-aa4a-5a47c9270ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:21.322487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4b288-a90f-445a-aa4a-5a47c9270ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:21.322783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4b288-a90f-445a-aa4a-5a47c9270ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:21.324141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc4b288-a90f-445a-aa4a-5a47c9270ba0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:21.336067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 538/1077] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:21.367740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2ee4-8b04-47bb-8226-5c22da3d658c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:21.368102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2ee4-8b04-47bb-8226-5c22da3d658c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:21.368292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c2ee4-8b04-47bb-8226-5c22da3d658c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:21.369724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 540/1078] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:21.375852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb194a-c8d5-4e37-bdbb-8c2dcabf7c32 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:21.376195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb194a-c8d5-4e37-bdbb-8c2dcabf7c32 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:21.376364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb194a-c8d5-4e37-bdbb-8c2dcabf7c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:21.396856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a8bb194a-c8d5-4e37-bdbb-8c2dcabf7c32 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:21.398023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a8bb194a-c8d5-4e37-bdbb-8c2dcabf7c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:21.431441 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:21.475783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 539/1079] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:21.739856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c2ee4-8b04-47bb-8226-5c22da3d658c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:21.845711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c2ee4-8b04-47bb-8226-5c22da3d658c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:21.879683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176725-f589-4333-a826-07b3171ff645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:21.880291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176725-f589-4333-a826-07b3171ff645 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:21.880562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176725-f589-4333-a826-07b3171ff645 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:21.880829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176725-f589-4333-a826-07b3171ff645 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:21.891194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59176725-f589-4333-a826-07b3171ff645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-59176725-f589-4333-a826-07b3171ff645 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:21.895945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:21.896920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:21.897841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 541/1080] 10.222.0.48 () {56 vars in 1120 bytes} [Sat Sep 17 03:25:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:21.903173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb194a-c8d5-4e37-bdbb-8c2dcabf7c32 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:22.006036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb194a-c8d5-4e37-bdbb-8c2dcabf7c32 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:22.042845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:22.043455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:22.043737 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:22.043999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:22.044661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:22.044961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:22.046356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:22.054517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 540/1081] 10.222.0.48 () {56 vars in 1115 bytes} [Sat Sep 17 03:25:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:22.060435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176725-f589-4333-a826-07b3171ff645 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:22.115303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:22.165295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176725-f589-4333-a826-07b3171ff645 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:22.199576 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:22.200195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:22.200469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:22.200738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:22.210809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:22.212247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:22.226937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:22.227909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:22.229242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:22.229242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:22.229242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:22.229242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 542/1082] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:22.234006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:22.265330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:22.338209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcfc60d-5366-425e-b73e-933f4d33fe2e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:22.372662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:22.373260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:22.373534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:22.373800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:22.374442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:22.374825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:22.376285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:22.388615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 541/1083] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:22.394642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:22.497915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed0831-68ba-455b-9b0d-9fd2bedaba2a None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:22.500293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:22.534730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:22.535281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:22.535632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:22.535886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:22.543340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:22.544811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:25:22.555950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:22.556913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:22.557913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 543/1084] 10.222.0.48 () {56 vars in 1093 bytes} [Sat Sep 17 03:25:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:22.563098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:22.651973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:22.665203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533f900-4330-4331-9473-aafb370fe3f4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:22.699910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dad588-0824-4861-9c0d-30afa71bf14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:22.700500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad588-0824-4861-9c0d-30afa71bf14a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:22.700769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad588-0824-4861-9c0d-30afa71bf14a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:22.701029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dad588-0824-4861-9c0d-30afa71bf14a None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:22.701745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad588-0824-4861-9c0d-30afa71bf14a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:22.702068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad588-0824-4861-9c0d-30afa71bf14a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:22.703482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dad588-0824-4861-9c0d-30afa71bf14a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:22.721426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 542/1085] 10.222.0.48 () {56 vars in 1133 bytes} [Sat Sep 17 03:25:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:22.727731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:22.834967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae858a-e424-4b58-9d4c-d612df3b0da7 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:22.871411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d76ee-fd78-4aa1-a318-a1bd461259ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:22.872077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d76ee-fd78-4aa1-a318-a1bd461259ef None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:22.872287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d76ee-fd78-4aa1-a318-a1bd461259ef None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:22.872559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973d76ee-fd78-4aa1-a318-a1bd461259ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:22.904156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:22.929770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc20545-0ae0-4af8-a0a2-f57c37623a1e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:22.930297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc20545-0ae0-4af8-a0a2-f57c37623a1e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:22.930297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc20545-0ae0-4af8-a0a2-f57c37623a1e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:22.931621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 543/1086] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:22.936639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cd3e-508d-4ab5-94ea-2b7de7495eb0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:22.936915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cd3e-508d-4ab5-94ea-2b7de7495eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:22.937179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993cd3e-508d-4ab5-94ea-2b7de7495eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:22.942727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d76ee-fd78-4aa1-a318-a1bd461259ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:22.944372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973d76ee-fd78-4aa1-a318-a1bd461259ef None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:22.955323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c993cd3e-508d-4ab5-94ea-2b7de7495eb0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:22.956481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c993cd3e-508d-4ab5-94ea-2b7de7495eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:23.024077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 544/1087] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:25:23.048027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 544/1088] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:23.053943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993cd3e-508d-4ab5-94ea-2b7de7495eb0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.129499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:23.152283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993cd3e-508d-4ab5-94ea-2b7de7495eb0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.186486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.187112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.187373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.187640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.197724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:23.199207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:23.213816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:23.214778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:25:23.215686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:23.215686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:25:23.215686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:23.215686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 545/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:23.220925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d76ee-fd78-4aa1-a318-a1bd461259ef None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.284034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:23.289163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.322913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973d76ee-fd78-4aa1-a318-a1bd461259ef None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.356104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.356706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.356979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.357245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.357926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:23.358224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:23.359597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:23.375409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 545/1090] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:23.376444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.389621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6766c39-b97b-4d41-9dc6-dfe94635c521 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.417898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:23.426451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dab6a7-8b78-429e-bead-6274d5e91bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.427070 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dab6a7-8b78-429e-bead-6274d5e91bdb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.427340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dab6a7-8b78-429e-bead-6274d5e91bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.427606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dab6a7-8b78-429e-bead-6274d5e91bdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.438684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dab6a7-8b78-429e-bead-6274d5e91bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-04dab6a7-8b78-429e-bead-6274d5e91bdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:23.443535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:23.444510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:23.445686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 546/1091] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:23.450661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dab6a7-8b78-429e-bead-6274d5e91bdb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.477893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c112e9c3-4260-471d-b567-83768ac5f0a4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.500083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:23.511700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.512430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.512711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.512983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.519499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:23.520948 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:25:23.532058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:23.533135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:23.534238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 546/1092] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:23.540009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.555484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dab6a7-8b78-429e-bead-6274d5e91bdb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.588186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.588797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.589076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.589345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.590053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:23.590364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:23.591733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:23.600541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 547/1093] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:23.606268 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.636249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dce474-633d-4611-895a-78ac3d66a1ca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.658236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:23.669532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.670177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.670459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.670731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.671425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:23.671728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:23.673172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:23.685827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 547/1094] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:23.692090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.705867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b693bd88-a7cd-4452-8605-bd9631077024 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.735544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:23.739143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7274be2-9c35-46fa-8686-44e0aef67b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.739771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7274be2-9c35-46fa-8686-44e0aef67b18 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.740049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7274be2-9c35-46fa-8686-44e0aef67b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.740319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7274be2-9c35-46fa-8686-44e0aef67b18 None admin] PATH_INFO: `/v3/users/3bb6d1a1eac14cffa5748f7d018e0563` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.741441 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7274be2-9c35-46fa-8686-44e0aef67b18 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb6d1a1eac14cffa5748f7d018e0563)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:23.742906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7274be2-9c35-46fa-8686-44e0aef67b18 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:23.749337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 548/1095] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/users/3bb6d1a1eac14cffa5748f7d018e0563 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:23.750273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7274be2-9c35-46fa-8686-44e0aef67b18 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:23.792658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12197d51-1db4-4dae-a72a-3def0cb4db5e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.826199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.826807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.827085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.827356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.828070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] RBAC: Adding query filter params (role.id=266b7d0aa48a4b4f83f29fd5699aa155, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=fda0f612b2ec42b2beac9af0b49ccff0) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:23.828377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:23.829846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:23.835615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 548/1096] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/role_assignments?user.id=fda0f612b2ec42b2beac9af0b49ccff0&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=266b7d0aa48a4b4f83f29fd5699aa155 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:23.848638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7274be2-9c35-46fa-8686-44e0aef67b18 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:23.868697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:23.887688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846f1be-9fa3-454a-ba8d-201b5ce27f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:23.888345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f1be-9fa3-454a-ba8d-201b5ce27f3e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:23.888620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f1be-9fa3-454a-ba8d-201b5ce27f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:23.888888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846f1be-9fa3-454a-ba8d-201b5ce27f3e None admin] PATH_INFO: `/v3/projects/ec7dbf621bef45caa8728298c76ec88c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:23.890156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846f1be-9fa3-454a-ba8d-201b5ce27f3e None admin] RBAC: Authorizing `identity:get_project(project_id=ec7dbf621bef45caa8728298c76ec88c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:23.891665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846f1be-9fa3-454a-ba8d-201b5ce27f3e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:23.893588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 549/1097] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:23 2022] GET /identity/v3/projects/ec7dbf621bef45caa8728298c76ec88c => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:23.900060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:24.015594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a822fd1-fb40-499e-8f76-cf63c4d8dee9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:24.024793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:24.051341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ae2ee3-267b-4691-bb2a-8e7d4551662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:24.051999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae2ee3-267b-4691-bb2a-8e7d4551662f None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:24.052271 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae2ee3-267b-4691-bb2a-8e7d4551662f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:24.052534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ae2ee3-267b-4691-bb2a-8e7d4551662f None admin] PATH_INFO: `/v3/projects/ec7dbf621bef45caa8728298c76ec88c/users/3bb6d1a1eac14cffa5748f7d018e0563/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:24.054440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae2ee3-267b-4691-bb2a-8e7d4551662f None admin] RBAC: Authorizing `identity:create_grant(project_id=ec7dbf621bef45caa8728298c76ec88c, user_id=3bb6d1a1eac14cffa5748f7d018e0563, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:24.055874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ae2ee3-267b-4691-bb2a-8e7d4551662f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:24.070407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 549/1098] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:25:23 2022] PUT /identity/v3/projects/ec7dbf621bef45caa8728298c76ec88c/users/3bb6d1a1eac14cffa5748f7d018e0563/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:25:26.175263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08a321-2852-4f60-aa56-d8e34d922361 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:26.176223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08a321-2852-4f60-aa56-d8e34d922361 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:26.176223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08a321-2852-4f60-aa56-d8e34d922361 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:26.178456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 550/1099] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:26.184832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643a81-6de7-44cf-90ba-056a8fcbce65 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:26.185574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643a81-6de7-44cf-90ba-056a8fcbce65 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:26.185733 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14643a81-6de7-44cf-90ba-056a8fcbce65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:26.212726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-14643a81-6de7-44cf-90ba-056a8fcbce65 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:26.213967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-14643a81-6de7-44cf-90ba-056a8fcbce65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:26.285622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 550/1100] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:26.547354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08a321-2852-4f60-aa56-d8e34d922361 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:26.653057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08a321-2852-4f60-aa56-d8e34d922361 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:26.688842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d1f36-1c95-4e83-a6b4-892560598151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:26.689677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1f36-1c95-4e83-a6b4-892560598151 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:26.690055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1f36-1c95-4e83-a6b4-892560598151 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:26.690419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d1f36-1c95-4e83-a6b4-892560598151 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:26.701101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d1f36-1c95-4e83-a6b4-892560598151 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-f35d1f36-1c95-4e83-a6b4-892560598151 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:26.705854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:26.707086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:26.708004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 551/1101] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:26.713167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643a81-6de7-44cf-90ba-056a8fcbce65 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:26.812075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:26.815980 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14643a81-6de7-44cf-90ba-056a8fcbce65 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:26.851462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:26.852058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:26.852329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:26.852600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:26.853259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:26.853559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:26.854977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:26.863053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 551/1102] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:25:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:26.872531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d1f36-1c95-4e83-a6b4-892560598151 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:26.934899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:26.991290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d1f36-1c95-4e83-a6b4-892560598151 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:27.032792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e84171-a87b-4088-8399-f51f806aca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:27.033685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e84171-a87b-4088-8399-f51f806aca54 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:27.034087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e84171-a87b-4088-8399-f51f806aca54 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:27.034488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e84171-a87b-4088-8399-f51f806aca54 None admin] PATH_INFO: `/v3/users/3bb6d1a1eac14cffa5748f7d018e0563` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:27.035992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e84171-a87b-4088-8399-f51f806aca54 None admin] RBAC: Authorizing `identity:get_user(user_id=3bb6d1a1eac14cffa5748f7d018e0563)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:27.037431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e84171-a87b-4088-8399-f51f806aca54 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:27.039052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 552/1103] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:26 2022] GET /identity/v3/users/3bb6d1a1eac14cffa5748f7d018e0563 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:27.045079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:27.149687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2963f-a643-4f76-930e-325738aded38 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:27.183587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f6c5-4a32-46c1-b345-70f40eb7c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:27.184178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f6c5-4a32-46c1-b345-70f40eb7c828 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:27.184447 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f6c5-4a32-46c1-b345-70f40eb7c828 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:27.184711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608f6c5-4a32-46c1-b345-70f40eb7c828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:27.213030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:27.257330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f6c5-4a32-46c1-b345-70f40eb7c828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:27.258825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608f6c5-4a32-46c1-b345-70f40eb7c828 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:27.367063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 552/1104] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:27.373305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e84171-a87b-4088-8399-f51f806aca54 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:27.477954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e84171-a87b-4088-8399-f51f806aca54 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:27.492793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:27.514115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee472f3-07bb-4ee7-8b98-f9a2c4e41a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:27.514744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee472f3-07bb-4ee7-8b98-f9a2c4e41a56 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:27.515019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee472f3-07bb-4ee7-8b98-f9a2c4e41a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:27.515288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee472f3-07bb-4ee7-8b98-f9a2c4e41a56 None admin] PATH_INFO: `/v3/projects/ec7dbf621bef45caa8728298c76ec88c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:27.516394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee472f3-07bb-4ee7-8b98-f9a2c4e41a56 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7dbf621bef45caa8728298c76ec88c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:27.517857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee472f3-07bb-4ee7-8b98-f9a2c4e41a56 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:27.519564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 553/1105] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:27 2022] GET /identity/v3/projects/ec7dbf621bef45caa8728298c76ec88c => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:27.526080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f6c5-4a32-46c1-b345-70f40eb7c828 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:27.583048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:27.623371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608f6c5-4a32-46c1-b345-70f40eb7c828 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:27.657131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2806f7-87b3-4a31-80ad-2481af5fc9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:27.657741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2806f7-87b3-4a31-80ad-2481af5fc9bc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:27.658048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2806f7-87b3-4a31-80ad-2481af5fc9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:27.658310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2806f7-87b3-4a31-80ad-2481af5fc9bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:27.659010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2806f7-87b3-4a31-80ad-2481af5fc9bc None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=ec7dbf621bef45caa8728298c76ec88c, user.id=3bb6d1a1eac14cffa5748f7d018e0563) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:27.659318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2806f7-87b3-4a31-80ad-2481af5fc9bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:27.660801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2806f7-87b3-4a31-80ad-2481af5fc9bc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:27.666878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 553/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:27 2022] GET /identity/v3/role_assignments?user.id=3bb6d1a1eac14cffa5748f7d018e0563&scope.project.id=ec7dbf621bef45caa8728298c76ec88c&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:29.795745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c0f2-5110-4f73-96b0-adff3a7ea2d0 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:29.796606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c0f2-5110-4f73-96b0-adff3a7ea2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:29.796606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886c0f2-5110-4f73-96b0-adff3a7ea2d0 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:29.798767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 554/1107] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:29.805817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae5f6-73cb-41c8-b7bc-337f852c10f7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:29.806240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae5f6-73cb-41c8-b7bc-337f852c10f7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:29.806346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ae5f6-73cb-41c8-b7bc-337f852c10f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:29.834906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bf2ae5f6-73cb-41c8-b7bc-337f852c10f7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:29.836095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bf2ae5f6-73cb-41c8-b7bc-337f852c10f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:29.905366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 554/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:30.169509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c0f2-5110-4f73-96b0-adff3a7ea2d0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:30.274393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886c0f2-5110-4f73-96b0-adff3a7ea2d0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:30.308339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215bc8d-5d00-4025-ab2c-6a2930cf6067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:30.308943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215bc8d-5d00-4025-ab2c-6a2930cf6067 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:30.309219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215bc8d-5d00-4025-ab2c-6a2930cf6067 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:30.309544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215bc8d-5d00-4025-ab2c-6a2930cf6067 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:30.310701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215bc8d-5d00-4025-ab2c-6a2930cf6067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:30.312122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b215bc8d-5d00-4025-ab2c-6a2930cf6067 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:30.313655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 555/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:30.320290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae5f6-73cb-41c8-b7bc-337f852c10f7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:30.392469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:30.448901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ae5f6-73cb-41c8-b7bc-337f852c10f7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:30.484640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f7755c-c850-4b30-bd7b-49c3816c01c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:30.485229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7755c-c850-4b30-bd7b-49c3816c01c5 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:30.485500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7755c-c850-4b30-bd7b-49c3816c01c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:30.485795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7755c-c850-4b30-bd7b-49c3816c01c5 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:30.486426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7755c-c850-4b30-bd7b-49c3816c01c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:30.487855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f7755c-c850-4b30-bd7b-49c3816c01c5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:30.514637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 555/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:25:30 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:32.662233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905aa5-1484-4c13-a5d8-ccd2dcb3e3fe None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:32.662834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905aa5-1484-4c13-a5d8-ccd2dcb3e3fe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:32.662834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905aa5-1484-4c13-a5d8-ccd2dcb3e3fe None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:32.664107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 556/1111] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:32.669592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7430-952c-42f1-8bc5-e82c10e322f9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:32.670056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7430-952c-42f1-8bc5-e82c10e322f9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:32.670156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d7430-952c-42f1-8bc5-e82c10e322f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:32.690295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-378d7430-952c-42f1-8bc5-e82c10e322f9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:32.691510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-378d7430-952c-42f1-8bc5-e82c10e322f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:32.761823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 556/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:33.026263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905aa5-1484-4c13-a5d8-ccd2dcb3e3fe None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:33.079191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:33.132385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905aa5-1484-4c13-a5d8-ccd2dcb3e3fe None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:33.167060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e707b9-7f84-48df-9b3f-c49c2f2bddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:33.167674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e707b9-7f84-48df-9b3f-c49c2f2bddde None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:33.167950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e707b9-7f84-48df-9b3f-c49c2f2bddde None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:33.168216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e707b9-7f84-48df-9b3f-c49c2f2bddde None admin] PATH_INFO: `/v3/roles/caea830f617d461ca08b1b747e2500a1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:33.169644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e707b9-7f84-48df-9b3f-c49c2f2bddde None admin] RBAC: Authorizing `identity:get_role(role_id=caea830f617d461ca08b1b747e2500a1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:33.171038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e707b9-7f84-48df-9b3f-c49c2f2bddde None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:33.172334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 557/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:33 2022] GET /identity/v3/roles/caea830f617d461ca08b1b747e2500a1 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:33.178340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7430-952c-42f1-8bc5-e82c10e322f9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:33.221336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:33.282114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d7430-952c-42f1-8bc5-e82c10e322f9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:33.318535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a32ff-9661-49d8-b0d9-4bef0171a768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:33.319155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a32ff-9661-49d8-b0d9-4bef0171a768 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:33.319426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a32ff-9661-49d8-b0d9-4bef0171a768 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:33.319688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a32ff-9661-49d8-b0d9-4bef0171a768 None admin] PATH_INFO: `/v3/users/b992033511114b71960435fbcb1fb169` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:33.334579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a32ff-9661-49d8-b0d9-4bef0171a768 None admin] RBAC: Authorizing `identity:get_user(user_id=b992033511114b71960435fbcb1fb169)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:33.336013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a32ff-9661-49d8-b0d9-4bef0171a768 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:33.337579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 557/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:33 2022] GET /identity/v3/users/b992033511114b71960435fbcb1fb169 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:33.346701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e707b9-7f84-48df-9b3f-c49c2f2bddde None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:33.451568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e707b9-7f84-48df-9b3f-c49c2f2bddde None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:33.468561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:33.486460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f6f1b-dfed-46ef-b3d3-a4bc6c2ead33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:33.487050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6f1b-dfed-46ef-b3d3-a4bc6c2ead33 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:33.487316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6f1b-dfed-46ef-b3d3-a4bc6c2ead33 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:33.487590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f6f1b-dfed-46ef-b3d3-a4bc6c2ead33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:33.558817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f6f1b-dfed-46ef-b3d3-a4bc6c2ead33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:33.560196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f6f1b-dfed-46ef-b3d3-a4bc6c2ead33 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:33.657559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 558/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:33.666482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a32ff-9661-49d8-b0d9-4bef0171a768 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:33.773897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:33.778089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a32ff-9661-49d8-b0d9-4bef0171a768 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:33.813247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802bc234-06bf-4fbf-814e-b4d8f523f9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:33.813782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bc234-06bf-4fbf-814e-b4d8f523f9bc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:33.814108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bc234-06bf-4fbf-814e-b4d8f523f9bc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:33.814379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802bc234-06bf-4fbf-814e-b4d8f523f9bc None admin] PATH_INFO: `/v3/projects/ec7dbf621bef45caa8728298c76ec88c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:33.815508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bc234-06bf-4fbf-814e-b4d8f523f9bc None admin] RBAC: Authorizing `identity:get_project(project_id=ec7dbf621bef45caa8728298c76ec88c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:33.817019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802bc234-06bf-4fbf-814e-b4d8f523f9bc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:33.818667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 558/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:33 2022] GET /identity/v3/projects/ec7dbf621bef45caa8728298c76ec88c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:33.825810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f6f1b-dfed-46ef-b3d3-a4bc6c2ead33 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:33.853776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:33.936446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f6f1b-dfed-46ef-b3d3-a4bc6c2ead33 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:33.974057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd97cb-8ad1-4eac-8274-b5c000df7f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:33.974633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd97cb-8ad1-4eac-8274-b5c000df7f2f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:33.974909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd97cb-8ad1-4eac-8274-b5c000df7f2f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:33.975174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd97cb-8ad1-4eac-8274-b5c000df7f2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:33.975886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd97cb-8ad1-4eac-8274-b5c000df7f2f None admin] RBAC: Adding query filter params (role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=ec7dbf621bef45caa8728298c76ec88c, user.id=b992033511114b71960435fbcb1fb169) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:33.976187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd97cb-8ad1-4eac-8274-b5c000df7f2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:33.977630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd97cb-8ad1-4eac-8274-b5c000df7f2f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:33.983253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 559/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:33 2022] GET /identity/v3/role_assignments?user.id=b992033511114b71960435fbcb1fb169&scope.project.id=ec7dbf621bef45caa8728298c76ec88c&role.id=caea830f617d461ca08b1b747e2500a1 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:36.070068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc320be-9bf9-4689-bf62-a614a5c3f77a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:36.070644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc320be-9bf9-4689-bf62-a614a5c3f77a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:36.070644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc320be-9bf9-4689-bf62-a614a5c3f77a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:36.071944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 559/1118] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:36.078261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7b475-06c5-4d8f-b0a7-0629166b3411 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:36.079006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7b475-06c5-4d8f-b0a7-0629166b3411 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:36.079151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c7b475-06c5-4d8f-b0a7-0629166b3411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:36.106467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-92c7b475-06c5-4d8f-b0a7-0629166b3411 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:36.107668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-92c7b475-06c5-4d8f-b0a7-0629166b3411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:36.179638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 560/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:36.449337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc320be-9bf9-4689-bf62-a614a5c3f77a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:36.558338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc320be-9bf9-4689-bf62-a614a5c3f77a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:36.600527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b01036-15a7-496b-a400-1cb91a5fe4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:36.601451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01036-15a7-496b-a400-1cb91a5fe4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:36.601901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01036-15a7-496b-a400-1cb91a5fe4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:36.602325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b01036-15a7-496b-a400-1cb91a5fe4d4 None admin] PATH_INFO: `/v3/roles/caea830f617d461ca08b1b747e2500a1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:36.604892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01036-15a7-496b-a400-1cb91a5fe4d4 None admin] RBAC: Authorizing `identity:get_role(role_id=caea830f617d461ca08b1b747e2500a1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:36.607133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b01036-15a7-496b-a400-1cb91a5fe4d4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:36.608842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 560/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:36 2022] GET /identity/v3/roles/caea830f617d461ca08b1b747e2500a1 => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:36.615120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7b475-06c5-4d8f-b0a7-0629166b3411 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:36.631279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:36.726446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c7b475-06c5-4d8f-b0a7-0629166b3411 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:36.761764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e845-86f1-472b-ac67-b74a1a5f16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:36.762398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e845-86f1-472b-ac67-b74a1a5f16c4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:36.762671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e845-86f1-472b-ac67-b74a1a5f16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:36.762936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9e845-86f1-472b-ac67-b74a1a5f16c4 None admin] PATH_INFO: `/v3/users/b992033511114b71960435fbcb1fb169` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:36.764154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e845-86f1-472b-ac67-b74a1a5f16c4 None admin] RBAC: Authorizing `identity:get_user(user_id=b992033511114b71960435fbcb1fb169)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:36.765582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9e845-86f1-472b-ac67-b74a1a5f16c4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:36.767170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 561/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:36 2022] GET /identity/v3/users/b992033511114b71960435fbcb1fb169 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:36.773516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b01036-15a7-496b-a400-1cb91a5fe4d4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:36.813008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:36.883950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b01036-15a7-496b-a400-1cb91a5fe4d4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:36.918570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea15202-388d-4006-ae60-18ed390f31a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:36.919186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15202-388d-4006-ae60-18ed390f31a8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:36.919456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15202-388d-4006-ae60-18ed390f31a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:36.919725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea15202-388d-4006-ae60-18ed390f31a8 None admin] PATH_INFO: `/v3/projects/ec7dbf621bef45caa8728298c76ec88c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:36.920871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea15202-388d-4006-ae60-18ed390f31a8 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7dbf621bef45caa8728298c76ec88c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:36.922338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea15202-388d-4006-ae60-18ed390f31a8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:36.923979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 561/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:36 2022] GET /identity/v3/projects/ec7dbf621bef45caa8728298c76ec88c => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:36.931461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e845-86f1-472b-ac67-b74a1a5f16c4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:37.021443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:37.041731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9e845-86f1-472b-ac67-b74a1a5f16c4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:37.077117 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c6f1f6-6591-454c-bef6-c32dee973a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:37.077782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6f1f6-6591-454c-bef6-c32dee973a63 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:37.078052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6f1f6-6591-454c-bef6-c32dee973a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:37.078314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c6f1f6-6591-454c-bef6-c32dee973a63 None admin] PATH_INFO: `/v3/projects/ec7dbf621bef45caa8728298c76ec88c/users/b992033511114b71960435fbcb1fb169/roles/caea830f617d461ca08b1b747e2500a1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:37.080749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6f1f6-6591-454c-bef6-c32dee973a63 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec7dbf621bef45caa8728298c76ec88c, user_id=b992033511114b71960435fbcb1fb169, role_id=caea830f617d461ca08b1b747e2500a1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:37.082195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c6f1f6-6591-454c-bef6-c32dee973a63 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:37.096477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 562/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:25:36 2022] PUT /identity/v3/projects/ec7dbf621bef45caa8728298c76ec88c/users/b992033511114b71960435fbcb1fb169/roles/caea830f617d461ca08b1b747e2500a1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:25:39.180091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381105e-dfc4-40c1-bf2a-1b940c1d7d7a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:39.180986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381105e-dfc4-40c1-bf2a-1b940c1d7d7a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:39.180986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381105e-dfc4-40c1-bf2a-1b940c1d7d7a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:39.183102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 562/1124] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:39.192253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28da1-5739-4f80-a5a6-ba3ac070f28f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:39.192664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28da1-5739-4f80-a5a6-ba3ac070f28f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:39.192834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b28da1-5739-4f80-a5a6-ba3ac070f28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:39.222425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e1b28da1-5739-4f80-a5a6-ba3ac070f28f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:39.223607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e1b28da1-5739-4f80-a5a6-ba3ac070f28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:39.299298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 563/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:39.572612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381105e-dfc4-40c1-bf2a-1b940c1d7d7a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:39.705884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381105e-dfc4-40c1-bf2a-1b940c1d7d7a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:39.707527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:39.743169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a8aec-725e-4b91-a935-b64d8875e45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:39.743788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8aec-725e-4b91-a935-b64d8875e45b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:39.744134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8aec-725e-4b91-a935-b64d8875e45b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:39.744407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8aec-725e-4b91-a935-b64d8875e45b None admin] PATH_INFO: `/v3/roles/caea830f617d461ca08b1b747e2500a1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:39.745864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a8aec-725e-4b91-a935-b64d8875e45b None admin] RBAC: Authorizing `identity:get_role(role_id=caea830f617d461ca08b1b747e2500a1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:39.747240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a8aec-725e-4b91-a935-b64d8875e45b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:39.748555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 563/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:39 2022] GET /identity/v3/roles/caea830f617d461ca08b1b747e2500a1 => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:39.754668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b28da1-5739-4f80-a5a6-ba3ac070f28f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:39.829478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:39.861614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b28da1-5739-4f80-a5a6-ba3ac070f28f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:39.900852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370eaff-07be-4d4c-8bec-0f5932ca039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:39.901467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370eaff-07be-4d4c-8bec-0f5932ca039a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:39.901771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370eaff-07be-4d4c-8bec-0f5932ca039a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:39.902053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370eaff-07be-4d4c-8bec-0f5932ca039a None admin] PATH_INFO: `/v3/users/b992033511114b71960435fbcb1fb169` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:39.903175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370eaff-07be-4d4c-8bec-0f5932ca039a None admin] RBAC: Authorizing `identity:get_user(user_id=b992033511114b71960435fbcb1fb169)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:39.904597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f370eaff-07be-4d4c-8bec-0f5932ca039a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:39.906202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 564/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:39 2022] GET /identity/v3/users/b992033511114b71960435fbcb1fb169 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:39.912478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a8aec-725e-4b91-a935-b64d8875e45b None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:40.032939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a8aec-725e-4b91-a935-b64d8875e45b None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:40.067963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684735b1-1b7b-4c7b-986d-b464b0658659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:40.068562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684735b1-1b7b-4c7b-986d-b464b0658659 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:40.068839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684735b1-1b7b-4c7b-986d-b464b0658659 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:40.069106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684735b1-1b7b-4c7b-986d-b464b0658659 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:40.109018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:40.149059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684735b1-1b7b-4c7b-986d-b464b0658659 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:40.150537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684735b1-1b7b-4c7b-986d-b464b0658659 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:40.251793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 564/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:40.261590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370eaff-07be-4d4c-8bec-0f5932ca039a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:40.377349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370eaff-07be-4d4c-8bec-0f5932ca039a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:40.415187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ca7ef9-b719-4493-a857-62065748de17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:40.415800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7ef9-b719-4493-a857-62065748de17 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:40.416067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7ef9-b719-4493-a857-62065748de17 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:40.416333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ca7ef9-b719-4493-a857-62065748de17 None admin] PATH_INFO: `/v3/projects/ec7dbf621bef45caa8728298c76ec88c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:40.417545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca7ef9-b719-4493-a857-62065748de17 None admin] RBAC: Authorizing `identity:get_project(project_id=ec7dbf621bef45caa8728298c76ec88c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:40.418997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ca7ef9-b719-4493-a857-62065748de17 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:40.420637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 565/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:40 2022] GET /identity/v3/projects/ec7dbf621bef45caa8728298c76ec88c => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:40.427466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684735b1-1b7b-4c7b-986d-b464b0658659 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:40.497359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:40.533836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684735b1-1b7b-4c7b-986d-b464b0658659 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:40.568670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea00519-e344-4053-820b-a752de25c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:40.569261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00519-e344-4053-820b-a752de25c3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:40.569533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00519-e344-4053-820b-a752de25c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:40.569801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea00519-e344-4053-820b-a752de25c3a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:40.570538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea00519-e344-4053-820b-a752de25c3a6 None admin] RBAC: Adding query filter params (role.id=caea830f617d461ca08b1b747e2500a1, scope.project.id=ec7dbf621bef45caa8728298c76ec88c, user.id=b992033511114b71960435fbcb1fb169) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:40.570846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea00519-e344-4053-820b-a752de25c3a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:40.572264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea00519-e344-4053-820b-a752de25c3a6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:40.578110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 565/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:40 2022] GET /identity/v3/role_assignments?user.id=b992033511114b71960435fbcb1fb169&scope.project.id=ec7dbf621bef45caa8728298c76ec88c&role.id=caea830f617d461ca08b1b747e2500a1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:42.698001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841c188-0470-41c4-9d45-132225fe338e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:42.698856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841c188-0470-41c4-9d45-132225fe338e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:42.698856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841c188-0470-41c4-9d45-132225fe338e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:42.700894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 566/1131] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:42.708461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fef7b-e794-4e68-8cb8-cfc5dcd9f200 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:42.708946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fef7b-e794-4e68-8cb8-cfc5dcd9f200 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:42.708946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fef7b-e794-4e68-8cb8-cfc5dcd9f200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:42.728382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e44fef7b-e794-4e68-8cb8-cfc5dcd9f200 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:42.729551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e44fef7b-e794-4e68-8cb8-cfc5dcd9f200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:42.798656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 566/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:43.066659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841c188-0470-41c4-9d45-132225fe338e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:43.076949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:43.174059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841c188-0470-41c4-9d45-132225fe338e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:43.211109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a06839-65ff-4bb7-83c9-341c10e56ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:43.211783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06839-65ff-4bb7-83c9-341c10e56ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:43.212063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06839-65ff-4bb7-83c9-341c10e56ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:43.212329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a06839-65ff-4bb7-83c9-341c10e56ff9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:43.213569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a06839-65ff-4bb7-83c9-341c10e56ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:43.215036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a06839-65ff-4bb7-83c9-341c10e56ff9 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:43.216597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 567/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:43.222448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fef7b-e794-4e68-8cb8-cfc5dcd9f200 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:43.287291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:43.328296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fef7b-e794-4e68-8cb8-cfc5dcd9f200 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:43.362730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11dfaf-571b-471f-8114-9f077c01b508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:43.363318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dfaf-571b-471f-8114-9f077c01b508 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:43.363589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dfaf-571b-471f-8114-9f077c01b508 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:43.363856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11dfaf-571b-471f-8114-9f077c01b508 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:43.364489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11dfaf-571b-471f-8114-9f077c01b508 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:43.365948 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11dfaf-571b-471f-8114-9f077c01b508 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:43.398226 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 567/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:25:43 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:45.542982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b652-c220-406d-a66a-972e6eb25798 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:45.543551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b652-c220-406d-a66a-972e6eb25798 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:45.543551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b652-c220-406d-a66a-972e6eb25798 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:45.544863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 568/1135] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:45.551481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467001-3b7d-499d-9bca-1fd9aefb9ddd None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:45.552165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467001-3b7d-499d-9bca-1fd9aefb9ddd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:45.552334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467001-3b7d-499d-9bca-1fd9aefb9ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:45.582518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-44467001-3b7d-499d-9bca-1fd9aefb9ddd None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:45.583813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-44467001-3b7d-499d-9bca-1fd9aefb9ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:45.658206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 568/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:45.926610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261b652-c220-406d-a66a-972e6eb25798 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:46.007797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:46.034905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261b652-c220-406d-a66a-972e6eb25798 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:46.073201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faddae3-6329-4acd-8349-07bf9677dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:46.073854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faddae3-6329-4acd-8349-07bf9677dfcd None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:46.074080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faddae3-6329-4acd-8349-07bf9677dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:46.074388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faddae3-6329-4acd-8349-07bf9677dfcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:46.075615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faddae3-6329-4acd-8349-07bf9677dfcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:46.077046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faddae3-6329-4acd-8349-07bf9677dfcd None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:46.078678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 569/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:25:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:46.084721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467001-3b7d-499d-9bca-1fd9aefb9ddd None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:46.132799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:46.191651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467001-3b7d-499d-9bca-1fd9aefb9ddd None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:46.227265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efe07b-fb78-4746-a050-a315401488ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:46.227889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe07b-fb78-4746-a050-a315401488ba None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:46.228164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe07b-fb78-4746-a050-a315401488ba None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:46.228431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efe07b-fb78-4746-a050-a315401488ba None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:46.229078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efe07b-fb78-4746-a050-a315401488ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:46.230537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efe07b-fb78-4746-a050-a315401488ba None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:46.254157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 569/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:25:46 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:25:48.405596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0dc2-69fb-497d-a33d-fe3de13d8d29 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:48.406202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0dc2-69fb-497d-a33d-fe3de13d8d29 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:48.406202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798a0dc2-69fb-497d-a33d-fe3de13d8d29 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:48.407517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 570/1139] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:48.414130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d92a5d-ea7a-4dc5-a44e-7ecce48ed9af None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:48.414816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d92a5d-ea7a-4dc5-a44e-7ecce48ed9af None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:48.415002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d92a5d-ea7a-4dc5-a44e-7ecce48ed9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:48.438044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c1d92a5d-ea7a-4dc5-a44e-7ecce48ed9af None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:48.439235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c1d92a5d-ea7a-4dc5-a44e-7ecce48ed9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:48.508904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 570/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:48.776540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0dc2-69fb-497d-a33d-fe3de13d8d29 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:48.880922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798a0dc2-69fb-497d-a33d-fe3de13d8d29 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:48.916149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55800ce1-de67-47cd-b42d-0f5a10a82abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:48.916756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55800ce1-de67-47cd-b42d-0f5a10a82abb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:48.917028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55800ce1-de67-47cd-b42d-0f5a10a82abb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:48.917328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55800ce1-de67-47cd-b42d-0f5a10a82abb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:48.928229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55800ce1-de67-47cd-b42d-0f5a10a82abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-55800ce1-de67-47cd-b42d-0f5a10a82abb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:48.932988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:48.934097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:48.935136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:48.937908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 571/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:25:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:48.940455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d92a5d-ea7a-4dc5-a44e-7ecce48ed9af None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:48.973333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:49.047555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d92a5d-ea7a-4dc5-a44e-7ecce48ed9af None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:49.081973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:49.082569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:49.082844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:49.083106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:49.083766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:49.084064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:49.085427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:49.093455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 571/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:25:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:49.099862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55800ce1-de67-47cd-b42d-0f5a10a82abb None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:49.103687 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:49.210384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55800ce1-de67-47cd-b42d-0f5a10a82abb None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:49.245685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8369b-a3c1-4f2b-9aa3-a6b9059b131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:49.246320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8369b-a3c1-4f2b-9aa3-a6b9059b131d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:49.246595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8369b-a3c1-4f2b-9aa3-a6b9059b131d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:49.246864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e8369b-a3c1-4f2b-9aa3-a6b9059b131d None admin] PATH_INFO: `/v3/users/2f49e1bcdc5d4752970fc99d0aeab81e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:49.260800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8369b-a3c1-4f2b-9aa3-a6b9059b131d None admin] RBAC: Authorizing `identity:get_user(user_id=2f49e1bcdc5d4752970fc99d0aeab81e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:49.262278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e8369b-a3c1-4f2b-9aa3-a6b9059b131d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:49.263867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 572/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:49 2022] GET /identity/v3/users/2f49e1bcdc5d4752970fc99d0aeab81e => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:49.271308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:49.376464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:49.384265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce254a-8cc2-4e98-aa60-171be57a0a43 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:49.419445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d3d21-3b90-4a79-abce-b4a6c795b185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:49.420093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d3d21-3b90-4a79-abce-b4a6c795b185 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:49.420318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d3d21-3b90-4a79-abce-b4a6c795b185 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:49.420582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d3d21-3b90-4a79-abce-b4a6c795b185 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:49.494867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d3d21-3b90-4a79-abce-b4a6c795b185 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:49.496327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d3d21-3b90-4a79-abce-b4a6c795b185 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:49.590639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:49.599567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 572/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:49.605920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8369b-a3c1-4f2b-9aa3-a6b9059b131d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:49.666250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:49.719421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e8369b-a3c1-4f2b-9aa3-a6b9059b131d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:49.754456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27100cef-92b6-471d-95d2-2b0b210c884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:49.755068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100cef-92b6-471d-95d2-2b0b210c884d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:49.755336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100cef-92b6-471d-95d2-2b0b210c884d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:49.755598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27100cef-92b6-471d-95d2-2b0b210c884d None admin] PATH_INFO: `/v3/projects/9c0a49875c75449d97eefcecf8edc52b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:49.756744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27100cef-92b6-471d-95d2-2b0b210c884d None admin] RBAC: Authorizing `identity:get_project(project_id=9c0a49875c75449d97eefcecf8edc52b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:49.758203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27100cef-92b6-471d-95d2-2b0b210c884d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:49.760179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 573/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:49 2022] GET /identity/v3/projects/9c0a49875c75449d97eefcecf8edc52b => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:49.767307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d3d21-3b90-4a79-abce-b4a6c795b185 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:49.880866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d3d21-3b90-4a79-abce-b4a6c795b185 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:49.916613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad489b1-aca6-478b-bf6d-cecb1be96985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:49.917131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad489b1-aca6-478b-bf6d-cecb1be96985 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:49.917403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad489b1-aca6-478b-bf6d-cecb1be96985 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:49.917667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad489b1-aca6-478b-bf6d-cecb1be96985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:49.918405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad489b1-aca6-478b-bf6d-cecb1be96985 None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=9c0a49875c75449d97eefcecf8edc52b, user.id=2f49e1bcdc5d4752970fc99d0aeab81e) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:49.918715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad489b1-aca6-478b-bf6d-cecb1be96985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:49.920129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad489b1-aca6-478b-bf6d-cecb1be96985 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:49.925545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 573/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:49 2022] GET /identity/v3/role_assignments?user.id=2f49e1bcdc5d4752970fc99d0aeab81e&scope.project.id=9c0a49875c75449d97eefcecf8edc52b&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:52.014124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a2ba-7278-4895-8dca-51da52c23bf0 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:52.014597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a2ba-7278-4895-8dca-51da52c23bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:52.014722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598a2ba-7278-4895-8dca-51da52c23bf0 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:52.016020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 574/1147] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:52.021574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d861b9-cd1b-4119-9956-620ac8db26c8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:52.021982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d861b9-cd1b-4119-9956-620ac8db26c8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:52.022148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d861b9-cd1b-4119-9956-620ac8db26c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:52.041488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d7d861b9-cd1b-4119-9956-620ac8db26c8 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:52.042711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d7d861b9-cd1b-4119-9956-620ac8db26c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:52.096947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:52.112800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 574/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:52.377458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a2ba-7278-4895-8dca-51da52c23bf0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:52.488232 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598a2ba-7278-4895-8dca-51da52c23bf0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:52.516874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:52.527770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252ad35-9b13-4064-b724-0dfb14977463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:52.528394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252ad35-9b13-4064-b724-0dfb14977463 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:52.528670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252ad35-9b13-4064-b724-0dfb14977463 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:52.528939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252ad35-9b13-4064-b724-0dfb14977463 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:52.542313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252ad35-9b13-4064-b724-0dfb14977463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0252ad35-9b13-4064-b724-0dfb14977463 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:52.547030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:52.548179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:52.549085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 575/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:52.554580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d861b9-cd1b-4119-9956-620ac8db26c8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:52.657482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d861b9-cd1b-4119-9956-620ac8db26c8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:52.693245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:52.693862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:52.694142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:52.694384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:52.695037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:52.695328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:52.696692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:52.704582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 575/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:52.714012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252ad35-9b13-4064-b724-0dfb14977463 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:52.818908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252ad35-9b13-4064-b724-0dfb14977463 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:52.853966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fe694-8cc5-4c66-9a41-52070de73d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:52.854581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fe694-8cc5-4c66-9a41-52070de73d19 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:52.854850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fe694-8cc5-4c66-9a41-52070de73d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:52.855112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fe694-8cc5-4c66-9a41-52070de73d19 None admin] PATH_INFO: `/v3/users/2f49e1bcdc5d4752970fc99d0aeab81e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:52.856251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fe694-8cc5-4c66-9a41-52070de73d19 None admin] RBAC: Authorizing `identity:get_user(user_id=2f49e1bcdc5d4752970fc99d0aeab81e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:52.857684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fe694-8cc5-4c66-9a41-52070de73d19 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:52.859305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 576/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:52 2022] GET /identity/v3/users/2f49e1bcdc5d4752970fc99d0aeab81e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:52.865507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:52.917560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:52.968006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122e0b6-e242-48f3-af83-6ed19927cbda None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:53.002020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9bd58c-1a03-44d7-8688-90895cc83a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:53.002640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bd58c-1a03-44d7-8688-90895cc83a4c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:53.002912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bd58c-1a03-44d7-8688-90895cc83a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:53.003178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9bd58c-1a03-44d7-8688-90895cc83a4c None admin] PATH_INFO: `/v3/projects/9c0a49875c75449d97eefcecf8edc52b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:53.004283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bd58c-1a03-44d7-8688-90895cc83a4c None admin] RBAC: Authorizing `identity:get_project(project_id=9c0a49875c75449d97eefcecf8edc52b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:53.005710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9bd58c-1a03-44d7-8688-90895cc83a4c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:53.007642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 576/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:52 2022] GET /identity/v3/projects/9c0a49875c75449d97eefcecf8edc52b => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:53.014104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fe694-8cc5-4c66-9a41-52070de73d19 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:53.078033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:53.125923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fe694-8cc5-4c66-9a41-52070de73d19 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:53.162238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b7682-afa3-402a-9640-c3f85bd6a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:53.162880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b7682-afa3-402a-9640-c3f85bd6a947 None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:53.163153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b7682-afa3-402a-9640-c3f85bd6a947 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:53.163424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b7682-afa3-402a-9640-c3f85bd6a947 None admin] PATH_INFO: `/v3/projects/9c0a49875c75449d97eefcecf8edc52b/users/2f49e1bcdc5d4752970fc99d0aeab81e/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:53.165555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b7682-afa3-402a-9640-c3f85bd6a947 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c0a49875c75449d97eefcecf8edc52b, user_id=2f49e1bcdc5d4752970fc99d0aeab81e, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:53.167027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b7682-afa3-402a-9640-c3f85bd6a947 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:53.182971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 577/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:25:53 2022] PUT /identity/v3/projects/9c0a49875c75449d97eefcecf8edc52b/users/2f49e1bcdc5d4752970fc99d0aeab81e/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:25:55.259832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76474f80-c110-4e45-a8f9-7669bdbf08d9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:55.260651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76474f80-c110-4e45-a8f9-7669bdbf08d9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:55.260651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76474f80-c110-4e45-a8f9-7669bdbf08d9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:55.262763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 577/1154] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:55.268579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc718-dd1c-4634-b32d-291aecb31f92 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:55.268995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc718-dd1c-4634-b32d-291aecb31f92 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:55.269108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ebc718-dd1c-4634-b32d-291aecb31f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:55.289259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-34ebc718-dd1c-4634-b32d-291aecb31f92 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:55.290488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-34ebc718-dd1c-4634-b32d-291aecb31f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:55.360646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 578/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:55.634124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76474f80-c110-4e45-a8f9-7669bdbf08d9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:55.748683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76474f80-c110-4e45-a8f9-7669bdbf08d9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:55.766399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:55.784805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919890e-a096-43a0-bbc9-4e6d097fe89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:55.785432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919890e-a096-43a0-bbc9-4e6d097fe89c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:55.785705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919890e-a096-43a0-bbc9-4e6d097fe89c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:55.785995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919890e-a096-43a0-bbc9-4e6d097fe89c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:55.796481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2919890e-a096-43a0-bbc9-4e6d097fe89c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-2919890e-a096-43a0-bbc9-4e6d097fe89c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:25:55.801220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:55.802331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:25:55.803323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 578/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:25:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:55.808660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc718-dd1c-4634-b32d-291aecb31f92 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:55.855300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:55.910644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ebc718-dd1c-4634-b32d-291aecb31f92 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:55.945553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:55.946176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:55.946447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:55.946709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:55.947361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:55.947652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:55.949010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:55.956895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 579/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:25:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:55.964005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919890e-a096-43a0-bbc9-4e6d097fe89c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:56.074185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2919890e-a096-43a0-bbc9-4e6d097fe89c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:56.111261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041897ad-0ee8-4426-814a-7be2ef36f217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:56.111971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041897ad-0ee8-4426-814a-7be2ef36f217 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:56.112249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041897ad-0ee8-4426-814a-7be2ef36f217 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:56.112523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041897ad-0ee8-4426-814a-7be2ef36f217 None admin] PATH_INFO: `/v3/users/2f49e1bcdc5d4752970fc99d0aeab81e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:56.113736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041897ad-0ee8-4426-814a-7be2ef36f217 None admin] RBAC: Authorizing `identity:get_user(user_id=2f49e1bcdc5d4752970fc99d0aeab81e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:56.115221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041897ad-0ee8-4426-814a-7be2ef36f217 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:56.116854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 579/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:25:55 2022] GET /identity/v3/users/2f49e1bcdc5d4752970fc99d0aeab81e => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:56.122798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:56.230322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8e5e2-6cd3-4dd4-b242-e1333931ecc0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:56.239317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:56.267574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569625-650a-4b5e-ab25-6ebd116eb99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:56.268582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569625-650a-4b5e-ab25-6ebd116eb99a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:56.268858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569625-650a-4b5e-ab25-6ebd116eb99a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:56.269419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a569625-650a-4b5e-ab25-6ebd116eb99a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:56.335972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569625-650a-4b5e-ab25-6ebd116eb99a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:56.337414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a569625-650a-4b5e-ab25-6ebd116eb99a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:56.437658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 580/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:56.444127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041897ad-0ee8-4426-814a-7be2ef36f217 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:56.497001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:56.562813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041897ad-0ee8-4426-814a-7be2ef36f217 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:56.597888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e42d7-7c49-412f-9d6f-4ed963669b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:56.598513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e42d7-7c49-412f-9d6f-4ed963669b79 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:56.598784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e42d7-7c49-412f-9d6f-4ed963669b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:56.599052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e42d7-7c49-412f-9d6f-4ed963669b79 None admin] PATH_INFO: `/v3/projects/9c0a49875c75449d97eefcecf8edc52b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:56.600195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e42d7-7c49-412f-9d6f-4ed963669b79 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0a49875c75449d97eefcecf8edc52b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:56.601618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e42d7-7c49-412f-9d6f-4ed963669b79 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:56.603322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 580/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:25:56 2022] GET /identity/v3/projects/9c0a49875c75449d97eefcecf8edc52b => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:25:56.612879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569625-650a-4b5e-ab25-6ebd116eb99a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:56.623931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:56.714850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a569625-650a-4b5e-ab25-6ebd116eb99a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:56.748997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ee442-2444-4f72-9c84-52434d021cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:56.749516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ee442-2444-4f72-9c84-52434d021cbb None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:56.749790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ee442-2444-4f72-9c84-52434d021cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:56.750027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ee442-2444-4f72-9c84-52434d021cbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:56.750782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ee442-2444-4f72-9c84-52434d021cbb None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=9c0a49875c75449d97eefcecf8edc52b, user.id=2f49e1bcdc5d4752970fc99d0aeab81e) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:56.751082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ee442-2444-4f72-9c84-52434d021cbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:56.752524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ee442-2444-4f72-9c84-52434d021cbb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:56.758865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 581/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:25:56 2022] GET /identity/v3/role_assignments?user.id=2f49e1bcdc5d4752970fc99d0aeab81e&scope.project.id=9c0a49875c75449d97eefcecf8edc52b&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:25:58.885663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f6fa-6558-4172-9f9f-aa7a671385b3 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:58.886632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f6fa-6558-4172-9f9f-aa7a671385b3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:58.886632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659f6fa-6558-4172-9f9f-aa7a671385b3 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:58.888766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 581/1162] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:25:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:25:58.895111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32007d-e3e3-4823-bac8-70d4184d5b71 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:58.895552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32007d-e3e3-4823-bac8-70d4184d5b71 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:58.895657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32007d-e3e3-4823-bac8-70d4184d5b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:58.924717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2a32007d-e3e3-4823-bac8-70d4184d5b71 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:25:58.925941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2a32007d-e3e3-4823-bac8-70d4184d5b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:25:58.998715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 582/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:25:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:25:59.264086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f6fa-6558-4172-9f9f-aa7a671385b3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:59.370377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659f6fa-6558-4172-9f9f-aa7a671385b3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:59.384484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:59.414351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d05a4-ca81-4840-a860-642330f799a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:59.414954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d05a4-ca81-4840-a860-642330f799a1 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:59.415227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d05a4-ca81-4840-a860-642330f799a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:59.415497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d05a4-ca81-4840-a860-642330f799a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:59.485988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d05a4-ca81-4840-a860-642330f799a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:59.488318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d05a4-ca81-4840-a860-642330f799a1 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:59.595116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 582/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:25:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:25:59.601973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32007d-e3e3-4823-bac8-70d4184d5b71 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:59.605167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:59.727188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32007d-e3e3-4823-bac8-70d4184d5b71 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:59.762807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f04b2-cd71-48ec-b59e-f1a1732a1900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:59.763429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04b2-cd71-48ec-b59e-f1a1732a1900 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:59.763705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04b2-cd71-48ec-b59e-f1a1732a1900 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:59.763977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f04b2-cd71-48ec-b59e-f1a1732a1900 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:59.770925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f04b2-cd71-48ec-b59e-f1a1732a1900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:59.772356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f04b2-cd71-48ec-b59e-f1a1732a1900 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-c10f04b2-cd71-48ec-b59e-f1a1732a1900 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:25:59.784689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:25:59.785905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:25:59.787605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 583/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:25:59 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:25:59.795228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d05a4-ca81-4840-a860-642330f799a1 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:25:59.812176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:25:59.900196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d05a4-ca81-4840-a860-642330f799a1 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:25:59.938047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57722327-4f3c-4ceb-9de0-8c9fdd479065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:25:59.938645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57722327-4f3c-4ceb-9de0-8c9fdd479065 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:25:59.938923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57722327-4f3c-4ceb-9de0-8c9fdd479065 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:25:59.939198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57722327-4f3c-4ceb-9de0-8c9fdd479065 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:25:59.939857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57722327-4f3c-4ceb-9de0-8c9fdd479065 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:25:59.940150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57722327-4f3c-4ceb-9de0-8c9fdd479065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:25:59.941529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57722327-4f3c-4ceb-9de0-8c9fdd479065 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:25:59.948676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 583/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Sat Sep 17 03:25:59 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:02.050459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325e09a-6b1e-4982-b8bb-3abf26f648fc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:02.051022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325e09a-6b1e-4982-b8bb-3abf26f648fc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:02.051022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1325e09a-6b1e-4982-b8bb-3abf26f648fc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:02.052356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 584/1167] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:26:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:26:02.059086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf23842-1aad-45a9-9a3f-57cf9335d694 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:02.059793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf23842-1aad-45a9-9a3f-57cf9335d694 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:02.059978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf23842-1aad-45a9-9a3f-57cf9335d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:02.086279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fcf23842-1aad-45a9-9a3f-57cf9335d694 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:26:02.087476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fcf23842-1aad-45a9-9a3f-57cf9335d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:26:02.161056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 584/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:26:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:26:02.424360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325e09a-6b1e-4982-b8bb-3abf26f648fc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:02.490211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:02.531562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1325e09a-6b1e-4982-b8bb-3abf26f648fc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:02.568716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8291424-9622-4dd6-806d-73b0bfff8920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:02.569316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8291424-9622-4dd6-806d-73b0bfff8920 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:02.569583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8291424-9622-4dd6-806d-73b0bfff8920 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:02.569858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8291424-9622-4dd6-806d-73b0bfff8920 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:02.570553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8291424-9622-4dd6-806d-73b0bfff8920 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:02.571919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8291424-9622-4dd6-806d-73b0bfff8920 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:02.591136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 585/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Sat Sep 17 03:26:02 2022] POST /identity/v3/domains => generated 267 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:26:04.726910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ae7e-7803-4260-a07c-723dd6332946 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:04.727484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ae7e-7803-4260-a07c-723dd6332946 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:04.727484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5ae7e-7803-4260-a07c-723dd6332946 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:04.728800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 585/1170] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:26:04.735293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f80a1-5595-481f-8fb5-d3067ade58b5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:04.736036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f80a1-5595-481f-8fb5-d3067ade58b5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:04.736170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f80a1-5595-481f-8fb5-d3067ade58b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:04.761847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4f2f80a1-5595-481f-8fb5-d3067ade58b5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:26:04.762969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4f2f80a1-5595-481f-8fb5-d3067ade58b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:26:04.831384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 586/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:26:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:26:05.097071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5ae7e-7803-4260-a07c-723dd6332946 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:05.113322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:05.219084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5ae7e-7803-4260-a07c-723dd6332946 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:05.255883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867fd37-e845-4bd0-9b5a-45ea7a01f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:05.256415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867fd37-e845-4bd0-9b5a-45ea7a01f684 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:05.256688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867fd37-e845-4bd0-9b5a-45ea7a01f684 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:05.256952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867fd37-e845-4bd0-9b5a-45ea7a01f684 None admin] PATH_INFO: `/v3/domains/a5b112e52b8f4f8ea23680a4c8297389` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:05.268198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867fd37-e845-4bd0-9b5a-45ea7a01f684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a5b112e52b8f4f8ea23680a4c8297389)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:05.269645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867fd37-e845-4bd0-9b5a-45ea7a01f684 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:05.271285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 586/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Sat Sep 17 03:26:05 2022] GET /identity/v3/domains/a5b112e52b8f4f8ea23680a4c8297389 => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:05.277880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f80a1-5595-481f-8fb5-d3067ade58b5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:05.331235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:05.386022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f80a1-5595-481f-8fb5-d3067ade58b5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:05.421063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb7fce-2524-40a0-9c9d-fa1547aada6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:05.421667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7fce-2524-40a0-9c9d-fa1547aada6e None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:05.421976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7fce-2524-40a0-9c9d-fa1547aada6e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:05.422244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb7fce-2524-40a0-9c9d-fa1547aada6e None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:05.422890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb7fce-2524-40a0-9c9d-fa1547aada6e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:05.424359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb7fce-2524-40a0-9c9d-fa1547aada6e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:05.453585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 587/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:26:05 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:26:07.617983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8251-d1c1-4832-97f5-8833be5383f1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:07.618565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8251-d1c1-4832-97f5-8833be5383f1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:07.618565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b8251-d1c1-4832-97f5-8833be5383f1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:07.619863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 587/1174] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:26:07.626554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4b85-8dd9-4d67-8eff-247dd9f48919 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:07.626998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4b85-8dd9-4d67-8eff-247dd9f48919 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:07.627107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d4b85-8dd9-4d67-8eff-247dd9f48919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:07.648188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c59d4b85-8dd9-4d67-8eff-247dd9f48919 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:26:07.649376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c59d4b85-8dd9-4d67-8eff-247dd9f48919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:26:07.724159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 588/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:26:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:26:07.988059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b8251-d1c1-4832-97f5-8833be5383f1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:08.064017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:08.101196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b8251-d1c1-4832-97f5-8833be5383f1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:08.136857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795e3a9-4340-4ef1-b130-fd21c822ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:08.137478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e3a9-4340-4ef1-b130-fd21c822ef73 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:08.137780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e3a9-4340-4ef1-b130-fd21c822ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:08.138045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795e3a9-4340-4ef1-b130-fd21c822ef73 None admin] PATH_INFO: `/v3/domains/a5b112e52b8f4f8ea23680a4c8297389` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:08.139195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795e3a9-4340-4ef1-b130-fd21c822ef73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a5b112e52b8f4f8ea23680a4c8297389)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:08.140624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795e3a9-4340-4ef1-b130-fd21c822ef73 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:08.142316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 588/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Sat Sep 17 03:26:07 2022] GET /identity/v3/domains/a5b112e52b8f4f8ea23680a4c8297389 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:08.148324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4b85-8dd9-4d67-8eff-247dd9f48919 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:08.183846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:08.250629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d4b85-8dd9-4d67-8eff-247dd9f48919 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:08.285648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85be31-1fda-4fbe-b25b-5b68b1aeced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:08.286277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85be31-1fda-4fbe-b25b-5b68b1aeced7 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:08.286550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85be31-1fda-4fbe-b25b-5b68b1aeced7 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:08.286819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85be31-1fda-4fbe-b25b-5b68b1aeced7 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:08.287476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85be31-1fda-4fbe-b25b-5b68b1aeced7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:08.288901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b85be31-1fda-4fbe-b25b-5b68b1aeced7 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:08.316029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 589/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:26:08 2022] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:26:10.474006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342ab4-e542-4b4b-a18d-a9e28891215d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:10.474912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342ab4-e542-4b4b-a18d-a9e28891215d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:10.474912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e342ab4-e542-4b4b-a18d-a9e28891215d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:10.477003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 589/1178] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:26:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:26:10.483549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc917-e4c4-47d0-b4b8-6e7837de7d50 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:10.484283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc917-e4c4-47d0-b4b8-6e7837de7d50 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:10.484453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfebc917-e4c4-47d0-b4b8-6e7837de7d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:10.505138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-dfebc917-e4c4-47d0-b4b8-6e7837de7d50 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:26:10.506349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dfebc917-e4c4-47d0-b4b8-6e7837de7d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:26:10.574669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 590/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:26:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:26:10.849683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e342ab4-e542-4b4b-a18d-a9e28891215d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:10.978394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e342ab4-e542-4b4b-a18d-a9e28891215d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:11.016015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3f380-fe7e-4786-b8a6-173f1f7c5c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:11.016723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f380-fe7e-4786-b8a6-173f1f7c5c53 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:11.016993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f380-fe7e-4786-b8a6-173f1f7c5c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:11.017260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3f380-fe7e-4786-b8a6-173f1f7c5c53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:11.020130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:11.032574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3f380-fe7e-4786-b8a6-173f1f7c5c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-dcd3f380-fe7e-4786-b8a6-173f1f7c5c53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:26:11.040376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:26:11.041599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:26:11.042673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 590/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:26:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:26:11.047938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebc917-e4c4-47d0-b4b8-6e7837de7d50 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:11.071646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:11.157916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfebc917-e4c4-47d0-b4b8-6e7837de7d50 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:11.194386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:11.194985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:11.195260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:11.195528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:11.196193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:26:11.196502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:11.197906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:11.206032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 591/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:26:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:11.212243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3f380-fe7e-4786-b8a6-173f1f7c5c53 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:11.331635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3f380-fe7e-4786-b8a6-173f1f7c5c53 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:11.366921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1c6a9-1c2e-490e-88c1-3526b13401f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:11.367527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c6a9-1c2e-490e-88c1-3526b13401f9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:11.367802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c6a9-1c2e-490e-88c1-3526b13401f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:11.368068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1c6a9-1c2e-490e-88c1-3526b13401f9 None admin] PATH_INFO: `/v3/users/4bc679edc9df4c9eba3d9d63f5b2b068` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:11.381971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1c6a9-1c2e-490e-88c1-3526b13401f9 None admin] RBAC: Authorizing `identity:get_user(user_id=4bc679edc9df4c9eba3d9d63f5b2b068)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:11.383455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b1c6a9-1c2e-490e-88c1-3526b13401f9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:11.385033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 591/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:26:11 2022] GET /identity/v3/users/4bc679edc9df4c9eba3d9d63f5b2b068 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:26:11.393451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:11.484506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:11.505832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c9112-aabf-405b-931e-cdf61b41b8e8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:11.541062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe699b0-ffa8-4a6e-9783-1a190939a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:11.541660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe699b0-ffa8-4a6e-9783-1a190939a93b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:11.541975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe699b0-ffa8-4a6e-9783-1a190939a93b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:11.542247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe699b0-ffa8-4a6e-9783-1a190939a93b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:11.613096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe699b0-ffa8-4a6e-9783-1a190939a93b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:11.614588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe699b0-ffa8-4a6e-9783-1a190939a93b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:11.704789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:11.736355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 592/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:26:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:26:11.745828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1c6a9-1c2e-490e-88c1-3526b13401f9 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:11.809002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:11.859458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1c6a9-1c2e-490e-88c1-3526b13401f9 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:11.895630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9edc79-24a6-42d0-999e-2132ef067d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:11.896261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9edc79-24a6-42d0-999e-2132ef067d68 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:11.896534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9edc79-24a6-42d0-999e-2132ef067d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:11.896801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9edc79-24a6-42d0-999e-2132ef067d68 None admin] PATH_INFO: `/v3/projects/86b07f7e896747438ceeb2264a3b9394` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:11.898218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9edc79-24a6-42d0-999e-2132ef067d68 None admin] RBAC: Authorizing `identity:get_project(project_id=86b07f7e896747438ceeb2264a3b9394)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:11.899666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9edc79-24a6-42d0-999e-2132ef067d68 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:11.901269 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 592/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:26:11 2022] GET /identity/v3/projects/86b07f7e896747438ceeb2264a3b9394 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:11.911275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe699b0-ffa8-4a6e-9783-1a190939a93b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:12.023710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe699b0-ffa8-4a6e-9783-1a190939a93b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:12.058921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f223f-e5fa-47ef-b16c-dff3083302fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:12.059519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f223f-e5fa-47ef-b16c-dff3083302fe None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:12.059797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f223f-e5fa-47ef-b16c-dff3083302fe None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:12.060067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f223f-e5fa-47ef-b16c-dff3083302fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:12.060789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f223f-e5fa-47ef-b16c-dff3083302fe None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=86b07f7e896747438ceeb2264a3b9394, user.id=4bc679edc9df4c9eba3d9d63f5b2b068) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:26:12.061098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f223f-e5fa-47ef-b16c-dff3083302fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:12.062549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f223f-e5fa-47ef-b16c-dff3083302fe None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:12.068136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 593/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:26:11 2022] GET /identity/v3/role_assignments?user.id=4bc679edc9df4c9eba3d9d63f5b2b068&scope.project.id=86b07f7e896747438ceeb2264a3b9394&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:14.145600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77032bc-9094-46e9-92ad-ab1029575aa6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:14.146202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77032bc-9094-46e9-92ad-ab1029575aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:14.146202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77032bc-9094-46e9-92ad-ab1029575aa6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:14.147522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 593/1186] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:26:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:26:14.153846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e647-7722-49bc-9139-a59ac42143a2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:14.154262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e647-7722-49bc-9139-a59ac42143a2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:14.154399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf0e647-7722-49bc-9139-a59ac42143a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:14.180696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-faf0e647-7722-49bc-9139-a59ac42143a2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:26:14.181945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-faf0e647-7722-49bc-9139-a59ac42143a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:26:14.234788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:14.262020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 594/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:26:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:26:14.523657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77032bc-9094-46e9-92ad-ab1029575aa6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:14.638721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77032bc-9094-46e9-92ad-ab1029575aa6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:14.661482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:14.675338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b544573-2620-4f1f-8f9a-45c38cd9bcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:14.675977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544573-2620-4f1f-8f9a-45c38cd9bcce None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:14.676250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544573-2620-4f1f-8f9a-45c38cd9bcce None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:14.676515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b544573-2620-4f1f-8f9a-45c38cd9bcce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:14.687557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b544573-2620-4f1f-8f9a-45c38cd9bcce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-8b544573-2620-4f1f-8f9a-45c38cd9bcce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:26:14.692404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:26:14.693536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:26:14.694628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 594/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:26:14.699643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0e647-7722-49bc-9139-a59ac42143a2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:14.802032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf0e647-7722-49bc-9139-a59ac42143a2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:14.846258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:14.846889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:14.847167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:14.847432 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:14.848089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:26:14.848413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:14.849798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:14.857980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 595/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:26:14.864636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b544573-2620-4f1f-8f9a-45c38cd9bcce None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:14.991640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b544573-2620-4f1f-8f9a-45c38cd9bcce None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:15.029779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7b951-732a-4f9e-bfeb-315f8e87041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:15.030416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7b951-732a-4f9e-bfeb-315f8e87041d None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:15.030697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7b951-732a-4f9e-bfeb-315f8e87041d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:15.030967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7b951-732a-4f9e-bfeb-315f8e87041d None admin] PATH_INFO: `/v3/users/4bc679edc9df4c9eba3d9d63f5b2b068` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:15.032252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7b951-732a-4f9e-bfeb-315f8e87041d None admin] RBAC: Authorizing `identity:get_user(user_id=4bc679edc9df4c9eba3d9d63f5b2b068)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:15.033732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7b951-732a-4f9e-bfeb-315f8e87041d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:15.035373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 595/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:26:14 2022] GET /identity/v3/users/4bc679edc9df4c9eba3d9d63f5b2b068 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:15.042543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:15.089918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:15.151093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3083b9-7616-4cec-bb47-3016bd6ef950 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:15.186217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd481c5-3dd5-494a-897e-9047f061d898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:15.186828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd481c5-3dd5-494a-897e-9047f061d898 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:15.187085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd481c5-3dd5-494a-897e-9047f061d898 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:15.187353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd481c5-3dd5-494a-897e-9047f061d898 None admin] PATH_INFO: `/v3/projects/86b07f7e896747438ceeb2264a3b9394` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:15.188671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd481c5-3dd5-494a-897e-9047f061d898 None admin] RBAC: Authorizing `identity:get_project(project_id=86b07f7e896747438ceeb2264a3b9394)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:15.190121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd481c5-3dd5-494a-897e-9047f061d898 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:15.191723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 596/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:26:15 2022] GET /identity/v3/projects/86b07f7e896747438ceeb2264a3b9394 => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:26:15.198005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7b951-732a-4f9e-bfeb-315f8e87041d None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:15.250801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:15.306028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7b951-732a-4f9e-bfeb-315f8e87041d None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:15.341813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921ee66-8cdc-42a4-b927-fe34b7afa09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:15.342414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921ee66-8cdc-42a4-b927-fe34b7afa09d None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:15.342691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921ee66-8cdc-42a4-b927-fe34b7afa09d None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:15.342960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921ee66-8cdc-42a4-b927-fe34b7afa09d None admin] PATH_INFO: `/v3/projects/86b07f7e896747438ceeb2264a3b9394/users/4bc679edc9df4c9eba3d9d63f5b2b068/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:15.345169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921ee66-8cdc-42a4-b927-fe34b7afa09d None admin] RBAC: Authorizing `identity:create_grant(project_id=86b07f7e896747438ceeb2264a3b9394, user_id=4bc679edc9df4c9eba3d9d63f5b2b068, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:15.346629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1921ee66-8cdc-42a4-b927-fe34b7afa09d None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:15.361958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 596/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:26:15 2022] PUT /identity/v3/projects/86b07f7e896747438ceeb2264a3b9394/users/4bc679edc9df4c9eba3d9d63f5b2b068/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:26:17.471280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f1088-1908-43f5-9ab1-8842feba3d99 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:17.472148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f1088-1908-43f5-9ab1-8842feba3d99 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:17.472148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f1088-1908-43f5-9ab1-8842feba3d99 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:17.474313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 597/1193] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:26:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:26:17.480753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145322f-cae4-4320-bd27-230f1aaa4281 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:17.481473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145322f-cae4-4320-bd27-230f1aaa4281 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:17.481619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145322f-cae4-4320-bd27-230f1aaa4281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:17.508317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3145322f-cae4-4320-bd27-230f1aaa4281 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:26:17.509498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3145322f-cae4-4320-bd27-230f1aaa4281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:26:17.578462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 597/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:26:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:26:17.844594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f1088-1908-43f5-9ab1-8842feba3d99 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:17.959516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f1088-1908-43f5-9ab1-8842feba3d99 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:17.966622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:17.995835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3070cc-65b7-415d-b7e8-40979179a319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:17.996454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3070cc-65b7-415d-b7e8-40979179a319 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:17.996728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3070cc-65b7-415d-b7e8-40979179a319 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:17.996988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3070cc-65b7-415d-b7e8-40979179a319 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:18.007869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3070cc-65b7-415d-b7e8-40979179a319 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9d3070cc-65b7-415d-b7e8-40979179a319 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:26:18.012588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:26:18.013715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:26:18.014934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 598/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:26:18.019823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145322f-cae4-4320-bd27-230f1aaa4281 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:18.066186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:18.134586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145322f-cae4-4320-bd27-230f1aaa4281 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:18.170029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:18.170628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:18.170900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:18.171179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:18.171831 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:26:18.172135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:18.173526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:18.181700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 598/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:26:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:18.190640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3070cc-65b7-415d-b7e8-40979179a319 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:18.292878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3070cc-65b7-415d-b7e8-40979179a319 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:18.328056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da06f91-d4a7-416e-a851-a821a448f639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:18.328657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da06f91-d4a7-416e-a851-a821a448f639 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:18.328928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da06f91-d4a7-416e-a851-a821a448f639 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:18.329195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da06f91-d4a7-416e-a851-a821a448f639 None admin] PATH_INFO: `/v3/users/4bc679edc9df4c9eba3d9d63f5b2b068` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:18.330379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da06f91-d4a7-416e-a851-a821a448f639 None admin] RBAC: Authorizing `identity:get_user(user_id=4bc679edc9df4c9eba3d9d63f5b2b068)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:18.331798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da06f91-d4a7-416e-a851-a821a448f639 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:18.333343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 599/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Sat Sep 17 03:26:18 2022] GET /identity/v3/users/4bc679edc9df4c9eba3d9d63f5b2b068 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:18.339202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:18.445543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddefd5d-607e-4b5b-97ee-1b45c4e66479 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:18.447056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:18.480431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72824c83-68ba-4e21-84af-79df64dd78ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:18.481018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824c83-68ba-4e21-84af-79df64dd78ca None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:18.481614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824c83-68ba-4e21-84af-79df64dd78ca None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:18.481614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72824c83-68ba-4e21-84af-79df64dd78ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:18.555494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72824c83-68ba-4e21-84af-79df64dd78ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:18.556951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72824c83-68ba-4e21-84af-79df64dd78ca None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:18.658958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 599/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:26:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:26:18.668446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da06f91-d4a7-416e-a851-a821a448f639 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:18.705176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:18.775435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da06f91-d4a7-416e-a851-a821a448f639 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:18.812075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c2a31-4973-4b24-800c-6129256f677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:18.812978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2a31-4973-4b24-800c-6129256f677a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:18.813352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2a31-4973-4b24-800c-6129256f677a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:18.813704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c2a31-4973-4b24-800c-6129256f677a None admin] PATH_INFO: `/v3/projects/86b07f7e896747438ceeb2264a3b9394` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:18.815418 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c2a31-4973-4b24-800c-6129256f677a None admin] RBAC: Authorizing `identity:get_project(project_id=86b07f7e896747438ceeb2264a3b9394)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:18.816840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c2a31-4973-4b24-800c-6129256f677a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:18.818479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 600/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Sat Sep 17 03:26:18 2022] GET /identity/v3/projects/86b07f7e896747438ceeb2264a3b9394 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:18.824686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72824c83-68ba-4e21-84af-79df64dd78ca None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:26:18.826897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:18.926560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72824c83-68ba-4e21-84af-79df64dd78ca None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:26:18.973025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8b0d6-ad2c-41a6-abc5-9ad90840a1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:26:18.973561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8b0d6-ad2c-41a6-abc5-9ad90840a1ab None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:26:18.973861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8b0d6-ad2c-41a6-abc5-9ad90840a1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:26:18.974126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8b0d6-ad2c-41a6-abc5-9ad90840a1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:26:18.974837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8b0d6-ad2c-41a6-abc5-9ad90840a1ab None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=86b07f7e896747438ceeb2264a3b9394, user.id=4bc679edc9df4c9eba3d9d63f5b2b068) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:26:18.975135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8b0d6-ad2c-41a6-abc5-9ad90840a1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:26:18.976597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8b0d6-ad2c-41a6-abc5-9ad90840a1ab None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:26:18.983060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 600/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:26:18 2022] GET /identity/v3/role_assignments?user.id=4bc679edc9df4c9eba3d9d63f5b2b068&scope.project.id=86b07f7e896747438ceeb2264a3b9394&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:26:28.806116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=49 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:26:28.979876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=67 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:14.610470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f6361-6573-4188-9eed-8be1a46bdb39 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:14.611122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f6361-6573-4188-9eed-8be1a46bdb39 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:14.611122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f6361-6573-4188-9eed-8be1a46bdb39 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:14.616426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 601/1201] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:14.618432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0901-3998-4d26-bf18-92685e196d8d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:14.618908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0901-3998-4d26-bf18-92685e196d8d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:14.619121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a0901-3998-4d26-bf18-92685e196d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:14.643463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2e2a0901-3998-4d26-bf18-92685e196d8d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:14.644811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2e2a0901-3998-4d26-bf18-92685e196d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:14.738248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 601/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:15.015463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f6361-6573-4188-9eed-8be1a46bdb39 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:15.152058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3f6361-6573-4188-9eed-8be1a46bdb39 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:15.192139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:15.192882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:15.193164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:15.193439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:15.210478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:15.212099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:15.228554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:15.229710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:15.231274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:15.231274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:15.231274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:15.233938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 602/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:15.236332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a0901-3998-4d26-bf18-92685e196d8d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:15.353997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a0901-3998-4d26-bf18-92685e196d8d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:15.386615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:15.393738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a974a7f9-c339-4e47-b7d9-730cf458736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:15.394406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974a7f9-c339-4e47-b7d9-730cf458736b None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:15.394691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974a7f9-c339-4e47-b7d9-730cf458736b None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:15.394962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a974a7f9-c339-4e47-b7d9-730cf458736b None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:15.395615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974a7f9-c339-4e47-b7d9-730cf458736b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:15.395921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974a7f9-c339-4e47-b7d9-730cf458736b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:15.397306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a974a7f9-c339-4e47-b7d9-730cf458736b None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:15.409723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 602/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:15.415886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:15.490298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:15.549805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057d103e-8fe8-43df-9f33-b03bd53e2247 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:15.594277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ae199-1b13-450b-bf89-677d445ebedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:15.595254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ae199-1b13-450b-bf89-677d445ebedb None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:15.596101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ae199-1b13-450b-bf89-677d445ebedb None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:15.596548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ae199-1b13-450b-bf89-677d445ebedb None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:15.597490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ae199-1b13-450b-bf89-677d445ebedb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:15.599520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ae199-1b13-450b-bf89-677d445ebedb None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:15.636725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 603/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Sat Sep 17 03:27:15 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:27:17.930448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923dc0-757f-450a-9035-5c07cfadbd94 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:17.931076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923dc0-757f-450a-9035-5c07cfadbd94 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:17.931076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2923dc0-757f-450a-9035-5c07cfadbd94 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:17.932572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 603/1206] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:17.939416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e1c34-c9d6-4b1e-80d4-79105bb6161c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:17.939898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e1c34-c9d6-4b1e-80d4-79105bb6161c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:17.939997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e1c34-c9d6-4b1e-80d4-79105bb6161c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:17.959089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7e7e1c34-c9d6-4b1e-80d4-79105bb6161c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:17.960258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7e7e1c34-c9d6-4b1e-80d4-79105bb6161c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:18.031215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 604/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:18.312578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923dc0-757f-450a-9035-5c07cfadbd94 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:18.430575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2923dc0-757f-450a-9035-5c07cfadbd94 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:18.465148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec150ae0-c0c4-4a2e-8907-82c4d3a95873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:18.465780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150ae0-c0c4-4a2e-8907-82c4d3a95873 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:18.466083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150ae0-c0c4-4a2e-8907-82c4d3a95873 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:18.466331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec150ae0-c0c4-4a2e-8907-82c4d3a95873 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:18.477042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec150ae0-c0c4-4a2e-8907-82c4d3a95873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-ec150ae0-c0c4-4a2e-8907-82c4d3a95873 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:27:18.482231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:18.483504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:18.484379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 604/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:27:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:18.490007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e1c34-c9d6-4b1e-80d4-79105bb6161c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:18.532723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:18.602879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e1c34-c9d6-4b1e-80d4-79105bb6161c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:18.637448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:18.638098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:18.638414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:18.638659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:18.639390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:18.639693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:18.641059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:18.649333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 605/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:27:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:18.655575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec150ae0-c0c4-4a2e-8907-82c4d3a95873 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:18.709162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:18.776959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec150ae0-c0c4-4a2e-8907-82c4d3a95873 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:18.817800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:18.818428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:18.818893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:18.818998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:18.832281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:18.834049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:18.852760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:18.854134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:18.855074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:18.855074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:18.855074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:18.855074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 605/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:18.860700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:18.974539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:18.977478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabce10c-d40f-488d-b120-476e55ea6b68 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:19.017129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:19.017834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:19.018118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:19.018446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:19.019211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:19.019556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:19.021094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:19.035339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 606/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:19.041315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:19.165992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729c0bb-d792-4ee7-a210-a641dce8f39c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:19.170146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:19.206797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:19.207467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:19.207776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:19.208077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:19.217080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:19.218722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:27:19.232480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:19.233604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:19.234722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 606/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:19.242163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:19.355212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdeec6a-32a4-48d1-ae54-b45a5b97a53b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:19.393292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:19.394027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:19.394367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:19.394698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:19.395495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:19.395871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:19.397362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:19.418489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 607/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Sat Sep 17 03:27:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:19.424330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:19.531506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72d6e5-cb33-4a91-a3b6-4ed2e24d8e36 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:19.570653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303de1-24e8-450e-ab6b-9ec781ba9a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:19.571560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303de1-24e8-450e-ab6b-9ec781ba9a20 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:19.571907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303de1-24e8-450e-ab6b-9ec781ba9a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:19.572242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6303de1-24e8-450e-ab6b-9ec781ba9a20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:19.610686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:19.655389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303de1-24e8-450e-ab6b-9ec781ba9a20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:19.657293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6303de1-24e8-450e-ab6b-9ec781ba9a20 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:19.782926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 607/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:27:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 03:27:19.788474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:19.809145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:19.901889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43815052-bf9e-41b8-b37e-6d88c523b7f3 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:19.945768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:19.946509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:19.946798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:19.947107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:19.960936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:19.963018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:19.980596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:19.982223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:19.983551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:19.983551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:19.983551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:19.987118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 608/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:19.988988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303de1-24e8-450e-ab6b-9ec781ba9a20 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:20.056022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:20.105956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6303de1-24e8-450e-ab6b-9ec781ba9a20 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:20.148910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:20.149909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:20.150250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:20.150526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:20.151282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:20.151729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:20.153525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:20.167324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 608/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:20.173194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:20.248519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:20.284403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e3a991-9457-429b-8030-0f839a20ec8d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:20.325299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:20.326074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:20.326461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:20.326796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:20.339109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:20.340747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:27:20.353453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:20.356164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:20.357288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 609/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:27:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:20.362268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:20.486295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bc642-c759-4ef3-855e-ded63f2df7ef None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:20.511481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:20.525667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe68cf-460b-4559-bd9b-8f1cba8e8345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:20.526337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe68cf-460b-4559-bd9b-8f1cba8e8345 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:20.526658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe68cf-460b-4559-bd9b-8f1cba8e8345 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:20.526879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe68cf-460b-4559-bd9b-8f1cba8e8345 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:20.527594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe68cf-460b-4559-bd9b-8f1cba8e8345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:20.527877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe68cf-460b-4559-bd9b-8f1cba8e8345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:20.529434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe68cf-460b-4559-bd9b-8f1cba8e8345 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:20.547158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 609/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:27:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:20.553634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:20.670465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fcdb3-8497-41b6-b637-42444d75d4c4 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:20.702694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:20.710416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff8ddb4-e022-4502-b547-c69c10b984a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:20.711094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8ddb4-e022-4502-b547-c69c10b984a4 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:20.711378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8ddb4-e022-4502-b547-c69c10b984a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:20.711656 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff8ddb4-e022-4502-b547-c69c10b984a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:20.712454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8ddb4-e022-4502-b547-c69c10b984a4 None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=c7145e2aeb94480da001aa620d1d4ebe) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:20.712818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8ddb4-e022-4502-b547-c69c10b984a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:20.714535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff8ddb4-e022-4502-b547-c69c10b984a4 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:20.721247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 610/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:27:20 2022] GET /identity/v3/role_assignments?user.id=c7145e2aeb94480da001aa620d1d4ebe&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:22.984277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261deef7-e86c-4d75-98dd-4874e29fec01 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:22.984706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261deef7-e86c-4d75-98dd-4874e29fec01 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:22.984841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261deef7-e86c-4d75-98dd-4874e29fec01 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:22.986291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 610/1220] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:22.992110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545267a2-5bbe-4202-b2dc-6b22f9700d90 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:22.992552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545267a2-5bbe-4202-b2dc-6b22f9700d90 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:22.992644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545267a2-5bbe-4202-b2dc-6b22f9700d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:23.013780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-545267a2-5bbe-4202-b2dc-6b22f9700d90 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:23.014991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-545267a2-5bbe-4202-b2dc-6b22f9700d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:23.087323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 611/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:23.354890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261deef7-e86c-4d75-98dd-4874e29fec01 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:23.478473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261deef7-e86c-4d75-98dd-4874e29fec01 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:23.515492 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606cde2-c13a-4047-9e05-ad42a029f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:23.516149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606cde2-c13a-4047-9e05-ad42a029f472 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:23.516407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606cde2-c13a-4047-9e05-ad42a029f472 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:23.516680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606cde2-c13a-4047-9e05-ad42a029f472 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:23.527041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606cde2-c13a-4047-9e05-ad42a029f472 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-5606cde2-c13a-4047-9e05-ad42a029f472 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:27:23.531859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:23.532991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:27:23.534193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:23.540316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 611/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:27:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:23.540746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545267a2-5bbe-4202-b2dc-6b22f9700d90 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:23.647940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545267a2-5bbe-4202-b2dc-6b22f9700d90 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:23.675173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:23.687950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:23.688704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:23.689062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:23.689387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:23.690363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:23.690675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:23.692665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:23.703760 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 612/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:27:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:23.709780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606cde2-c13a-4047-9e05-ad42a029f472 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:23.762872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:23.826631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606cde2-c13a-4047-9e05-ad42a029f472 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:23.863294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:23.863970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:23.864301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:23.864574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:23.875666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:23.877314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:23.894700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:23.895896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:23.896940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:23.896940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:23.896940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:23.896940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 612/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:23.902507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:24.015187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4155b7-1c9f-4ad5-8f7f-233a82e9bb2a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:24.053399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:24.054078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:24.054390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:24.054704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:24.055450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:24.055754 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:24.057237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:24.070265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 613/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:24.076434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:24.175582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:24.183231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b077e-fcd2-4ef0-9566-6d3a3d4ec11f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:24.219467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:24.220198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:24.220462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:24.220749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:24.228538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:24.230016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:27:24.241320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:24.242485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:24.243669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 613/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:27:24.251087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:24.302855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:24.363046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bf33-20e1-47c9-9e65-94d2f2950d04 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:24.400996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:24.401650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:24.401960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:24.402242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:24.403010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:24.403393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:24.405073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:24.422978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 614/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Sat Sep 17 03:27:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:24.429423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:24.546493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbee821-f7ad-49d3-abcb-09c15504bdd8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:24.587064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:24.587947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:24.588321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:24.588682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:24.599847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:24.601595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:24.618812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:24.620234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:24.621348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:24.621348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:24.621348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:24.621348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 614/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:24.626715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:24.739161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9b7f2-b60d-4698-bc93-75ef8f186615 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:24.742162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:24.779597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:24.780220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:24.780499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:24.780762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:24.781527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:24.781718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:24.783138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:24.796090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 615/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:24.803107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:24.814074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:24.907495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293a61d-78ff-458f-b3ec-28dc1904f998 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:24.941986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:24.942624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:24.942899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:24.943163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:24.950041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:24.951522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:27:24.963239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:24.964327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:24.965257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 615/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:27:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:24.970536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:25.078907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75930608-0ca5-4605-8683-fee28e7e2cb8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:25.112919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5562d-fb63-4442-8d62-474c0e3fc05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:25.113582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5562d-fb63-4442-8d62-474c0e3fc05d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:25.113951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5562d-fb63-4442-8d62-474c0e3fc05d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:25.114225 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5562d-fb63-4442-8d62-474c0e3fc05d None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:25.114957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5562d-fb63-4442-8d62-474c0e3fc05d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:25.115271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5562d-fb63-4442-8d62-474c0e3fc05d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:25.116721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5562d-fb63-4442-8d62-474c0e3fc05d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:25.130682 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 616/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:27:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:25.137154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:25.210567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:25.250497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d016ca-25d5-4511-9b4b-fbf27ee43f97 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:25.288730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26203ac-9223-4da2-8c29-9208cdbbcde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:25.289836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26203ac-9223-4da2-8c29-9208cdbbcde6 None admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:25.290283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26203ac-9223-4da2-8c29-9208cdbbcde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:25.290731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26203ac-9223-4da2-8c29-9208cdbbcde6 None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/c7145e2aeb94480da001aa620d1d4ebe/roles/92f1f6b31904491bb73824b634599912` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:25.308405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26203ac-9223-4da2-8c29-9208cdbbcde6 None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=c7145e2aeb94480da001aa620d1d4ebe, role_id=92f1f6b31904491bb73824b634599912)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:25.309971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26203ac-9223-4da2-8c29-9208cdbbcde6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:25.324946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 616/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:27:25 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/c7145e2aeb94480da001aa620d1d4ebe/roles/92f1f6b31904491bb73824b634599912 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:27:27.539869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61577-07fc-4db8-9ec5-3898ba9a37cf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:27.540612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61577-07fc-4db8-9ec5-3898ba9a37cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:27.540612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d61577-07fc-4db8-9ec5-3898ba9a37cf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:27.541808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 617/1233] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:27.547403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f354bf-0675-4dde-b606-9b3c51f2724f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:27.547914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f354bf-0675-4dde-b606-9b3c51f2724f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:27.548043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f354bf-0675-4dde-b606-9b3c51f2724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:27.568282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-85f354bf-0675-4dde-b606-9b3c51f2724f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:27.569571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-85f354bf-0675-4dde-b606-9b3c51f2724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:27.647312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 617/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 03:27:27.921838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61577-07fc-4db8-9ec5-3898ba9a37cf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:27.951855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:28.055106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d61577-07fc-4db8-9ec5-3898ba9a37cf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:28.096457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e972f-fda5-49be-8666-41f031fbc8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:28.097087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e972f-fda5-49be-8666-41f031fbc8dc None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:28.097358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e972f-fda5-49be-8666-41f031fbc8dc None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:28.097634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e972f-fda5-49be-8666-41f031fbc8dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:28.109406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82e972f-fda5-49be-8666-41f031fbc8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-b82e972f-fda5-49be-8666-41f031fbc8dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:27:28.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:28.115731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:28.116731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 618/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Sat Sep 17 03:27:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:28.122104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f354bf-0675-4dde-b606-9b3c51f2724f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:28.178797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:28.239371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f354bf-0675-4dde-b606-9b3c51f2724f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:28.277551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:28.278290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:28.278665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:28.279000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:28.279747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] RBAC: Adding query filter params (name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:28.280105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:28.281551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:28.291474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 618/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Sat Sep 17 03:27:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:27:28.298479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e972f-fda5-49be-8666-41f031fbc8dc None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:28.384937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:28.402086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e972f-fda5-49be-8666-41f031fbc8dc None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:28.437365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:28.437956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:28.438230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:28.438496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:28.449202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:28.451114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:28.467211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:28.468589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:28.469540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:28.469540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:28.469540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:28.469540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 619/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:28.474663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:28.584994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8241a1c-4a68-4215-8dc8-7793353ad10f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:28.594785 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:28.626705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:28.627478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:28.627743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:28.628083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:28.628751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:28.629058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:28.630595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:28.645324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 619/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:28.651475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:28.760188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f032a12-2685-4ad3-826a-dae02f947c21 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:28.795943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:28.796596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:28.796893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:28.797165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:28.799857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:28.807091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:28.809030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:27:28.822620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:28.823840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:28.825045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 620/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:27:28.832260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:28.950661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d37cd6-7f9f-4054-84ff-a6fb9a414661 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:28.992774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:28.993562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:28.994010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:28.994405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:28.995395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:28.995858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:28.997942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:29.018260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 620/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Sat Sep 17 03:27:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:29.024841 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:29.126209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07998b3e-b8bb-4c7d-84be-a8feedeeabe2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:29.171714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ebf2-44be-4e91-a756-e7e26932b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:29.172506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ebf2-44be-4e91-a756-e7e26932b215 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:29.172780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ebf2-44be-4e91-a756-e7e26932b215 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:29.173083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ebf2-44be-4e91-a756-e7e26932b215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:29.238637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:29.246923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ebf2-44be-4e91-a756-e7e26932b215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:29.248572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ebf2-44be-4e91-a756-e7e26932b215 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:29.363772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 621/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:27:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:27:29.369509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:29.399426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:29.479788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db977afc-0c8f-4af7-9e94-68e3acb1c474 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:29.514652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:29.515283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:29.515557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:29.515818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:29.526364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:29.527850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:29.543410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:29.544655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:29.546276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:29.546276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:29.546276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:29.550000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 621/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:29.551164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ebf2-44be-4e91-a756-e7e26932b215 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:29.648485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:29.655206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ebf2-44be-4e91-a756-e7e26932b215 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:29.691300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:29.692086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:29.692415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:29.692758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:29.693455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:29.693800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:29.695591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:29.708662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 622/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:27:29.714913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:29.798800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:29.821614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55989983-ff66-42c6-af4a-e1bde4e86095 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:29.855754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:29.856483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:29.856753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:29.857036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:29.863436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:29.864876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:27:29.876657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:29.877800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:29.878896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 622/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:27:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:29.883689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:29.994126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4f02d-68b8-44cf-92c6-7cd4c7d6dd17 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:30.031024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697d096-74b6-4c3b-9457-e57c305dfbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:30.031637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697d096-74b6-4c3b-9457-e57c305dfbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:30.031910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697d096-74b6-4c3b-9457-e57c305dfbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:30.032211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697d096-74b6-4c3b-9457-e57c305dfbc0 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:30.032864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697d096-74b6-4c3b-9457-e57c305dfbc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:30.033167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697d096-74b6-4c3b-9457-e57c305dfbc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:30.034675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697d096-74b6-4c3b-9457-e57c305dfbc0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:30.047055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 623/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:27:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:30.053609 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:30.164608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b1135-525f-49e5-9b37-efd28617f6c0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:30.204317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847999e-61dc-4082-9d45-0d6aee03b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:30.204945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847999e-61dc-4082-9d45-0d6aee03b04a None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:30.205224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847999e-61dc-4082-9d45-0d6aee03b04a None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:30.205541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847999e-61dc-4082-9d45-0d6aee03b04a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:30.206259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847999e-61dc-4082-9d45-0d6aee03b04a None admin] RBAC: Adding query filter params (role.id=92f1f6b31904491bb73824b634599912, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=c7145e2aeb94480da001aa620d1d4ebe) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:30.206561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847999e-61dc-4082-9d45-0d6aee03b04a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:30.208012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847999e-61dc-4082-9d45-0d6aee03b04a None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:30.214129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 623/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:27:30 2022] GET /identity/v3/role_assignments?user.id=c7145e2aeb94480da001aa620d1d4ebe&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=92f1f6b31904491bb73824b634599912 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:32.471860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ad71-5f50-405a-b90c-3013dde89b11 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:32.471860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ad71-5f50-405a-b90c-3013dde89b11 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:32.471860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a1ad71-5f50-405a-b90c-3013dde89b11 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:32.471860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 624/1247] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:32.477233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cea31-68ef-4cdb-abcf-145482fe82d4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:32.477699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cea31-68ef-4cdb-abcf-145482fe82d4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:32.477699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cea31-68ef-4cdb-abcf-145482fe82d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:32.484256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:32.497484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f97cea31-68ef-4cdb-abcf-145482fe82d4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:32.498760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f97cea31-68ef-4cdb-abcf-145482fe82d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:32.574639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 624/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:32.853321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1ad71-5f50-405a-b90c-3013dde89b11 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:32.873016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:32.978383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a1ad71-5f50-405a-b90c-3013dde89b11 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:33.022720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2c3a4-6b18-47ae-adf3-4a0f2fe9304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:33.023359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c3a4-6b18-47ae-adf3-4a0f2fe9304d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:33.023638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c3a4-6b18-47ae-adf3-4a0f2fe9304d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:33.023909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c3a4-6b18-47ae-adf3-4a0f2fe9304d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:33.036101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2c3a4-6b18-47ae-adf3-4a0f2fe9304d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-5ed2c3a4-6b18-47ae-adf3-4a0f2fe9304d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:27:33.041431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:33.042772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:33.044032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 625/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:33.049210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cea31-68ef-4cdb-abcf-145482fe82d4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:33.153937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cea31-68ef-4cdb-abcf-145482fe82d4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:33.186386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:33.192044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:33.192758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:33.193063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:33.193404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:33.194131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:33.194431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:33.195800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:33.204220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 625/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:27:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:27:33.210326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2c3a4-6b18-47ae-adf3-4a0f2fe9304d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:33.293927 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:33.317250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2c3a4-6b18-47ae-adf3-4a0f2fe9304d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:33.351196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:33.351824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:33.352099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:33.352379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:33.362741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:33.364193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:33.380664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:33.381984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:33.383139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:33.383139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:33.383139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:33.383139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 626/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:33.388226 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:33.500240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46e903-7949-4985-82a5-ba4250a3c0da None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:33.534562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:33.535174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:33.535452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:33.535722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:33.536356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:33.536657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:33.538074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:33.550679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 626/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:33.556662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:33.663980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b6152b-01e2-4b10-90bb-fecf588fbcfa None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:33.692216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:33.702583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:33.703547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:33.703835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:33.704131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:33.713077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:33.714756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:27:33.729367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:33.730657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:33.732148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 627/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:33.737074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:33.797783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:33.846519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3636159-9f3f-407d-aa33-bb0e7ecd9bf8 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:33.891463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:33.892083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:33.892356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:33.892622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:33.893342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:33.893640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:33.895107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:33.912617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 627/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Sat Sep 17 03:27:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:33.919065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:34.026107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163c3e57-6c21-4d61-b121-086fe5583111 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:34.062944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1586f-df9a-4c2b-854b-0663e63552d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:34.063475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1586f-df9a-4c2b-854b-0663e63552d1 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:34.063773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1586f-df9a-4c2b-854b-0663e63552d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:34.064011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e1586f-df9a-4c2b-854b-0663e63552d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:34.124669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:34.139116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1586f-df9a-4c2b-854b-0663e63552d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:34.140781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e1586f-df9a-4c2b-854b-0663e63552d1 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:34.253777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 628/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:27:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 03:27:34.261782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:34.372382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c080e8-7e26-4fad-94af-f3e4907c299e None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:34.388718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:34.412815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:34.413472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:34.413787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:34.414052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:34.425643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:34.427157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:34.443170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:34.444281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:34.445227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:34.445227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:34.445227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:34.445227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 628/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:34.450650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1586f-df9a-4c2b-854b-0663e63552d1 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:34.552871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:34.566762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e1586f-df9a-4c2b-854b-0663e63552d1 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:34.604312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:34.604942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:34.605223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:34.605491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:34.606237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:34.606535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:34.607930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:34.620774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 629/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:34.627406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:34.736632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33507ba6-f9d1-43f3-9d93-35a33f44156c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:34.774024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:34.774653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:34.774924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:34.775191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:34.781850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:34.784073 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:27:34.795636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:34.796564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:34.797513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 629/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:27:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:34.803058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:34.904292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740276a2-1dd4-43be-bbc5-6f65a7322f71 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:34.938016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c25dda-da77-4d55-a788-9efc68f59cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:34.938633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c25dda-da77-4d55-a788-9efc68f59cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:34.938930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c25dda-da77-4d55-a788-9efc68f59cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:34.939191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c25dda-da77-4d55-a788-9efc68f59cb0 None admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:34.939878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c25dda-da77-4d55-a788-9efc68f59cb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:34.940179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c25dda-da77-4d55-a788-9efc68f59cb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:34.941615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c25dda-da77-4d55-a788-9efc68f59cb0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:34.954150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 630/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:27:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:34.960655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:34.986896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:35.064726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58827414-c930-4181-9a38-3d5636a6b1b0 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:35.098726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd83ee-4ae7-48fe-94fc-cd7be7e416df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:35.099330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd83ee-4ae7-48fe-94fc-cd7be7e416df None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:35.099603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd83ee-4ae7-48fe-94fc-cd7be7e416df None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:35.099865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd83ee-4ae7-48fe-94fc-cd7be7e416df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:35.100578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd83ee-4ae7-48fe-94fc-cd7be7e416df None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=c7145e2aeb94480da001aa620d1d4ebe) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:35.100877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd83ee-4ae7-48fe-94fc-cd7be7e416df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:35.102350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd83ee-4ae7-48fe-94fc-cd7be7e416df None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:35.107958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 630/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:27:34 2022] GET /identity/v3/role_assignments?user.id=c7145e2aeb94480da001aa620d1d4ebe&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:37.185187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60027234-cd87-429e-b3da-243875457aa0 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:37.185844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60027234-cd87-429e-b3da-243875457aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:37.185844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60027234-cd87-429e-b3da-243875457aa0 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:37.187102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 631/1261] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:37.193372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09194e05-20fe-4706-872b-b359fdba74c6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:37.194094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09194e05-20fe-4706-872b-b359fdba74c6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:37.194305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09194e05-20fe-4706-872b-b359fdba74c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:37.216807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-09194e05-20fe-4706-872b-b359fdba74c6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:37.218014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-09194e05-20fe-4706-872b-b359fdba74c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:37.289745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 631/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:37.550967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60027234-cd87-429e-b3da-243875457aa0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:37.563414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:37.669069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60027234-cd87-429e-b3da-243875457aa0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:37.707940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18802-0f53-44e8-b6e2-84d93af23d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:37.708993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18802-0f53-44e8-b6e2-84d93af23d2f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:37.709443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18802-0f53-44e8-b6e2-84d93af23d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:37.710207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18802-0f53-44e8-b6e2-84d93af23d2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:37.725057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18802-0f53-44e8-b6e2-84d93af23d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-aca18802-0f53-44e8-b6e2-84d93af23d2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:27:37.730796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:37.731971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:37.733218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 632/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:27:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:37.738787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09194e05-20fe-4706-872b-b359fdba74c6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:37.760499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:37.847142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09194e05-20fe-4706-872b-b359fdba74c6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:37.885439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:37.886355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:37.886723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:37.887072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:37.887742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:37.888045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:37.889428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:37.898231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 632/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:27:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:27:37.907479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18802-0f53-44e8-b6e2-84d93af23d2f None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:37.977051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:38.012124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18802-0f53-44e8-b6e2-84d93af23d2f None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:38.046693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:38.047310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:38.047580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:38.047846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:38.058605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:38.060057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:38.074838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:38.075911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:38.076970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:38.076970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:38.076970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:38.076970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 633/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:38.081997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:38.166519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:38.189871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507814d9-2d2d-42cb-8e5a-13be0301d8b4 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:38.224366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:38.224959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:38.225213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:38.225477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:38.226136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:38.226432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:38.227802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:38.240181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 633/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:38.246137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:38.360146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53bf37-3587-4b19-b9b6-03b6cd6ab59e None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:38.380032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:38.402990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:38.403606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:38.403880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:38.404146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:38.412648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:38.414139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:27:38.425308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:38.426457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:38.427586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 634/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:27:38.432523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:38.545657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7355a-5114-4aa9-86bd-7d0d5b9bce28 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:38.580696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:38.581285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:38.581557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:38.581853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:38.582562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:38.582861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:38.584298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:38.594028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:38.603347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 634/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Sat Sep 17 03:27:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:38.609384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:38.722377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cb271-0a6c-4aff-a522-21acd9356d5d None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:38.763082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:38.763703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:38.763977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:38.764239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:38.774465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:38.775900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:38.789899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:38.790956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:38.792109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:38.792109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:38.792109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:38.792109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 635/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:38.797165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:38.904703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e89dcf-c7b4-46bd-a5ac-f1235d0325b5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:38.944164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:38.944756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:38.945023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:38.945287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:38.945946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:38.946239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:38.947585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:38.958942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 635/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:27:38.964659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:39.002898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:39.085334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342652f-9bf9-408e-966d-1ea297bc3ab0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:39.121885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:39.122502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:39.122773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:39.123042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:39.130096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:39.131525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:27:39.142565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:39.143608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:39.144531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 636/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:39.149789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:39.212970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:39.270075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348843d1-a375-451e-a1c8-c92012eb0987 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:39.306696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25392c2d-fe68-42a8-8fc7-a6c0eb00d1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:39.307294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392c2d-fe68-42a8-8fc7-a6c0eb00d1b9 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:39.307573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392c2d-fe68-42a8-8fc7-a6c0eb00d1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:39.307837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25392c2d-fe68-42a8-8fc7-a6c0eb00d1b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:39.308707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25392c2d-fe68-42a8-8fc7-a6c0eb00d1b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:39.309020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25392c2d-fe68-42a8-8fc7-a6c0eb00d1b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:39.310475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25392c2d-fe68-42a8-8fc7-a6c0eb00d1b9 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:39.322308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 636/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:27:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:39.328635 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:39.426715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:39.436816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6656886f-901c-4325-9f73-6fa3c0c06583 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:39.471624 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acc4be-5a22-45eb-8932-be069af3974d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:39.472270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc4be-5a22-45eb-8932-be069af3974d None admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:39.472541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc4be-5a22-45eb-8932-be069af3974d None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:39.472814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acc4be-5a22-45eb-8932-be069af3974d None admin] PATH_INFO: `/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/c7145e2aeb94480da001aa620d1d4ebe/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:39.474823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acc4be-5a22-45eb-8932-be069af3974d None admin] RBAC: Authorizing `identity:create_grant(project_id=bbefb73feca0406e97651d79e9052cc5, user_id=c7145e2aeb94480da001aa620d1d4ebe, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:39.476248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acc4be-5a22-45eb-8932-be069af3974d None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:39.492719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 637/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Sat Sep 17 03:27:39 2022] PUT /identity/v3/projects/bbefb73feca0406e97651d79e9052cc5/users/c7145e2aeb94480da001aa620d1d4ebe/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:27:41.586186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db390e-0fdb-46cb-8cda-84fb7065dab6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:41.586759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db390e-0fdb-46cb-8cda-84fb7065dab6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:41.586759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db390e-0fdb-46cb-8cda-84fb7065dab6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:41.588061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 637/1274] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:41.594460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539a92-b7cb-4dc0-ab7a-060b459a6337 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:41.595200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539a92-b7cb-4dc0-ab7a-060b459a6337 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:41.595334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13539a92-b7cb-4dc0-ab7a-060b459a6337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:41.618556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-13539a92-b7cb-4dc0-ab7a-060b459a6337 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:41.619756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-13539a92-b7cb-4dc0-ab7a-060b459a6337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:41.688997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 638/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:41.968743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db390e-0fdb-46cb-8cda-84fb7065dab6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:42.074470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db390e-0fdb-46cb-8cda-84fb7065dab6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:42.091792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:42.110209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb318f7c-3e2b-4553-af69-bf1011f5d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:42.110821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb318f7c-3e2b-4553-af69-bf1011f5d610 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:42.111091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb318f7c-3e2b-4553-af69-bf1011f5d610 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:42.111355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb318f7c-3e2b-4553-af69-bf1011f5d610 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:42.121993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb318f7c-3e2b-4553-af69-bf1011f5d610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-bb318f7c-3e2b-4553-af69-bf1011f5d610 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 03:27:42.127026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:42.128050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:42.129068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 638/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Sat Sep 17 03:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:42.134264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13539a92-b7cb-4dc0-ab7a-060b459a6337 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:42.210977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:42.230258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13539a92-b7cb-4dc0-ab7a-060b459a6337 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:42.265868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:42.266407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:42.266681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:42.266914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:42.267595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:42.268224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:42.269578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:42.278773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 639/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Sat Sep 17 03:27:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:42.285886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb318f7c-3e2b-4553-af69-bf1011f5d610 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:42.388151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb318f7c-3e2b-4553-af69-bf1011f5d610 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:42.424072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:42.424681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:42.424953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:42.425218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:42.435667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:42.437110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:42.452034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:42.453152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:42.454363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:42.454363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:42.454363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:42.454363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 639/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:42.459595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:42.565359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0847833-c876-45f6-ab00-3e52b818f8d2 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:42.602480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:42.603141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:42.603337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:42.603605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:42.604241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:42.604538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:42.605990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:42.617602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 640/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:27:42.623836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:42.660520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:42.738613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7443639-d36c-4a67-8301-5fa8ca0ba3cd None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:42.775622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:42.776229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:42.776503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:42.776766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:42.784149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:42.785599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 03:27:42.796811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:42.797930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:42.798922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 640/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:42.804248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:42.808980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:42.915561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e179a-6a64-4ec8-9d2d-7b0d637401e0 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:42.950931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:42.951527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:42.951805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:42.952078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:42.952800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:42.953110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:42.954554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:42.971474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 641/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Sat Sep 17 03:27:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:42.978751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:43.079293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:43.090141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6d0ee-eebb-4671-bc5b-742d049d0bb2 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:43.127082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33396-e4fc-4e9b-a6d5-435c38f5fd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:43.127676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33396-e4fc-4e9b-a6d5-435c38f5fd4f None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:43.127950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33396-e4fc-4e9b-a6d5-435c38f5fd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:43.128220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e33396-e4fc-4e9b-a6d5-435c38f5fd4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:43.210017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33396-e4fc-4e9b-a6d5-435c38f5fd4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:43.211436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e33396-e4fc-4e9b-a6d5-435c38f5fd4f None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:43.305806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:43.316558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 641/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Sat Sep 17 03:27:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 03:27:43.325830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:43.391632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:43.438851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b7c59f-87ea-4aec-aba0-9c1d0dca249b None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:43.472136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:43.472688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:43.472959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:43.473219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:43.483463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:43.484889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 03:27:43.499928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:43.501064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 03:27:43.502051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 03:27:43.502051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 03:27:43.502051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:43.502051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 642/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:43.507078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33396-e4fc-4e9b-a6d5-435c38f5fd4f None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:43.609378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e33396-e4fc-4e9b-a6d5-435c38f5fd4f None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:43.645643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:43.646263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:43.646534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:43.646803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:43.647439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:43.647743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:43.649108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:43.660245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 642/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Sat Sep 17 03:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:43.666132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:43.765516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432db528-8fc5-4aaa-ab6a-d3e59e5f26a8 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:43.783807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:43.805457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:43.806107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:43.806383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:43.806657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:43.813326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:43.814796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 03:27:43.826723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:43.827744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: ERROR keystone.server.flask.application Sep 17 03:27:43.829031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 643/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Sat Sep 17 03:27:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 03:27:43.833770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:43.887262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:43.938470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f4cb-165f-484c-a30d-a03dfc4b3657 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:43.974550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07709d2a-b600-48be-8d4b-8ca3f90ab1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:43.975150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07709d2a-b600-48be-8d4b-8ca3f90ab1f6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:43.975424 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07709d2a-b600-48be-8d4b-8ca3f90ab1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:43.975713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07709d2a-b600-48be-8d4b-8ca3f90ab1f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:43.976390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07709d2a-b600-48be-8d4b-8ca3f90ab1f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:43.976692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07709d2a-b600-48be-8d4b-8ca3f90ab1f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:43.978154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07709d2a-b600-48be-8d4b-8ca3f90ab1f6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:43.990924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 643/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Sat Sep 17 03:27:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:43.997322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:44.103488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388469d-46d4-4784-a16b-8cff9ce64398 None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:44.138270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e6fdeb-04f3-486b-aa69-09e4eb5c9181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:44.138850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6fdeb-04f3-486b-aa69-09e4eb5c9181 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:44.139127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6fdeb-04f3-486b-aa69-09e4eb5c9181 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:44.139390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e6fdeb-04f3-486b-aa69-09e4eb5c9181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:44.140111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6fdeb-04f3-486b-aa69-09e4eb5c9181 None admin] RBAC: Adding query filter params (role.id=6288295bacf743c8ad7468f8f1d55674, scope.project.id=bbefb73feca0406e97651d79e9052cc5, user.id=c7145e2aeb94480da001aa620d1d4ebe) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:44.140422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6fdeb-04f3-486b-aa69-09e4eb5c9181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:44.141875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e6fdeb-04f3-486b-aa69-09e4eb5c9181 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:44.147643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 644/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Sat Sep 17 03:27:43 2022] GET /identity/v3/role_assignments?user.id=c7145e2aeb94480da001aa620d1d4ebe&scope.project.id=bbefb73feca0406e97651d79e9052cc5&role.id=6288295bacf743c8ad7468f8f1d55674 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:46.262397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1079bb-505e-4488-83dc-005622b3a73a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:46.263000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1079bb-505e-4488-83dc-005622b3a73a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:46.263000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1079bb-505e-4488-83dc-005622b3a73a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:46.264191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 644/1288] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:46.270672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c45a-f5e8-4f82-addf-8124cd58f7e9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:46.271374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c45a-f5e8-4f82-addf-8124cd58f7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:46.271553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1c45a-f5e8-4f82-addf-8124cd58f7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:46.298706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ffe1c45a-f5e8-4f82-addf-8124cd58f7e9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:46.299896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ffe1c45a-f5e8-4f82-addf-8124cd58f7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:46.331131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:46.370294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 645/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:46.630877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1079bb-505e-4488-83dc-005622b3a73a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:46.755376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1079bb-505e-4488-83dc-005622b3a73a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:46.770567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:46.796805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:46.797426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:46.797696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:46.797989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:46.798557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:46.799905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:46.808704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:46.813984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:46.815144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 645/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:27:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:46.815990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1c45a-f5e8-4f82-addf-8124cd58f7e9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:46.916119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1c45a-f5e8-4f82-addf-8124cd58f7e9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:46.950038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81603c-89c4-4dff-9ff6-713162601b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:46.950631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81603c-89c4-4dff-9ff6-713162601b08 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:46.950907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81603c-89c4-4dff-9ff6-713162601b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:46.951170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81603c-89c4-4dff-9ff6-713162601b08 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:46.951797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81603c-89c4-4dff-9ff6-713162601b08 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:46.952098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81603c-89c4-4dff-9ff6-713162601b08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:46.953448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81603c-89c4-4dff-9ff6-713162601b08 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:46.958295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 646/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Sat Sep 17 03:27:46 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:46.964664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:47.081278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a615548-1a1d-475e-bebb-06eccd1723b5 None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:47.116120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0cd830-9a86-4ba9-b828-7da989de5ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:47.116718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd830-9a86-4ba9-b828-7da989de5ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:47.116992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd830-9a86-4ba9-b828-7da989de5ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:47.117258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0cd830-9a86-4ba9-b828-7da989de5ba6 None admin] PATH_INFO: `/v3/services` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:47.117907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cd830-9a86-4ba9-b828-7da989de5ba6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:47.118198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cd830-9a86-4ba9-b828-7da989de5ba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:47.119564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0cd830-9a86-4ba9-b828-7da989de5ba6 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:47.126397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 646/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Sat Sep 17 03:27:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:49.205010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccc78-1af5-4cf5-9008-a9ab24d22368 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:49.205568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccc78-1af5-4cf5-9008-a9ab24d22368 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:49.205568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ccc78-1af5-4cf5-9008-a9ab24d22368 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:49.206909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 647/1293] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:27:49.213189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690b8f-6119-4249-9c23-58385a7f5c28 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:49.213941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690b8f-6119-4249-9c23-58385a7f5c28 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:49.214089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63690b8f-6119-4249-9c23-58385a7f5c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:49.240257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-63690b8f-6119-4249-9c23-58385a7f5c28 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:49.241375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-63690b8f-6119-4249-9c23-58385a7f5c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:49.276635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:49.316759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 647/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:49.585661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ccc78-1af5-4cf5-9008-a9ab24d22368 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:49.627137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:49.703386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ccc78-1af5-4cf5-9008-a9ab24d22368 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:49.749499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bab54cf-d309-47a0-a82b-b46ddff13866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:49.750130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab54cf-d309-47a0-a82b-b46ddff13866 None admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:49.750419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab54cf-d309-47a0-a82b-b46ddff13866 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:49.750694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bab54cf-d309-47a0-a82b-b46ddff13866 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:49.751376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab54cf-d309-47a0-a82b-b46ddff13866 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:49.752744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bab54cf-d309-47a0-a82b-b46ddff13866 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:49.770752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 648/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Sat Sep 17 03:27:49 2022] POST /identity/v3/services => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:27:51.896282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c8b4-dfee-48b3-9521-f7e300f9627a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:51.896890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c8b4-dfee-48b3-9521-f7e300f9627a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:51.896890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c8b4-dfee-48b3-9521-f7e300f9627a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:51.898336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 648/1296] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:51.904877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab0863-9029-4e8d-a3bf-5bc3835f2a66 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:51.905564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab0863-9029-4e8d-a3bf-5bc3835f2a66 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:51.905706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ab0863-9029-4e8d-a3bf-5bc3835f2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:51.934862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c7ab0863-9029-4e8d-a3bf-5bc3835f2a66 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:51.936047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c7ab0863-9029-4e8d-a3bf-5bc3835f2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:52.013971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 649/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:52.286974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4c8b4-dfee-48b3-9521-f7e300f9627a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:52.403861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4c8b4-dfee-48b3-9521-f7e300f9627a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:52.438902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:52.439510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:52.439780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:52.440042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:52.440605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:52.442003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:52.451125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:52.452281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:52.453588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 649/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:27:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:52.458338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab0863-9029-4e8d-a3bf-5bc3835f2a66 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:52.477112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:52.569554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ab0863-9029-4e8d-a3bf-5bc3835f2a66 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:52.606920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:52.607516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:52.607785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:52.608048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:52.608669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:52.608971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:52.610368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:52.615466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 650/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Sat Sep 17 03:27:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:52.622791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:52.665521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:52.749332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c3c4d-143f-46e4-8dd9-a40755ad23fc None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:52.789884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea09025-eb7b-4bbf-b517-0b3f068cf897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:52.790502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea09025-eb7b-4bbf-b517-0b3f068cf897 None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:52.790781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea09025-eb7b-4bbf-b517-0b3f068cf897 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:52.791054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea09025-eb7b-4bbf-b517-0b3f068cf897 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:52.791785 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea09025-eb7b-4bbf-b517-0b3f068cf897 None admin] RBAC: Adding query filter params (interface=public, service_id=b2c8b8b03cd948d0ad3d15fbd0c3b4aa, region_id=RegionOne) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:52.792121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea09025-eb7b-4bbf-b517-0b3f068cf897 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:52.793511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea09025-eb7b-4bbf-b517-0b3f068cf897 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:52.798828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 650/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Sat Sep 17 03:27:52 2022] GET /identity/v3/endpoints?service_id=b2c8b8b03cd948d0ad3d15fbd0c3b4aa&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:52.804839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:52.893343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:52.911471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f525d-76b7-443c-acf4-dcab8c48604a None admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:52.945845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1573964-4481-436f-8043-8bf181e1936f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:52.946448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573964-4481-436f-8043-8bf181e1936f None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:52.946723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573964-4481-436f-8043-8bf181e1936f None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:52.946985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1573964-4481-436f-8043-8bf181e1936f None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:52.947585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1573964-4481-436f-8043-8bf181e1936f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:52.949046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1573964-4481-436f-8043-8bf181e1936f None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:52.956537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 651/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Sat Sep 17 03:27:52 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:27:55.085727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6727a-8f76-46c1-88bd-476303f9e5b3 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:55.086651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6727a-8f76-46c1-88bd-476303f9e5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:55.086761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6727a-8f76-46c1-88bd-476303f9e5b3 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:55.088799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 651/1302] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:27:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:27:55.095164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce5d9e-fd66-4449-a353-9b148f91bd86 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:55.095603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce5d9e-fd66-4449-a353-9b148f91bd86 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:55.095698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce5d9e-fd66-4449-a353-9b148f91bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:55.117711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d1ce5d9e-fd66-4449-a353-9b148f91bd86 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:27:55.118939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d1ce5d9e-fd66-4449-a353-9b148f91bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:27:55.188548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 652/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:27:55 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 03:27:55.451538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6727a-8f76-46c1-88bd-476303f9e5b3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:55.553642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:55.561502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6727a-8f76-46c1-88bd-476303f9e5b3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:55.596100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:55.596718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:55.596992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:55.597254 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:55.597859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:55.599243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 03:27:55.608277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 03:27:55.609374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application with Lock( Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self._enter() Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application return self.creator() Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application created_value = creator( Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: ERROR keystone.server.flask.application Sep 17 03:27:55.610849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 652/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Sat Sep 17 03:27:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 03:27:55.620370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce5d9e-fd66-4449-a353-9b148f91bd86 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:55.710254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:27:55.734779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce5d9e-fd66-4449-a353-9b148f91bd86 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:55.768277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d7ea-abeb-4786-81aa-080f5b7f67c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:55.768873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d7ea-abeb-4786-81aa-080f5b7f67c0 None admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:55.769141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d7ea-abeb-4786-81aa-080f5b7f67c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:55.769401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d7ea-abeb-4786-81aa-080f5b7f67c0 None admin] PATH_INFO: `/v3/services` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:55.770054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74d7ea-abeb-4786-81aa-080f5b7f67c0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:27:55.770343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74d7ea-abeb-4786-81aa-080f5b7f67c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:55.771700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74d7ea-abeb-4786-81aa-080f5b7f67c0 None admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:55.776915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 653/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Sat Sep 17 03:27:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:27:55.782965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:27:55.887596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b9c0db-69ac-4ebb-9f63-e48606444b4c None admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:27:55.923893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455cf51-6e3f-44bd-ad49-e0041673a2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:27:55.924489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455cf51-6e3f-44bd-ad49-e0041673a2c7 None admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:27:55.924762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455cf51-6e3f-44bd-ad49-e0041673a2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:27:55.925026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455cf51-6e3f-44bd-ad49-e0041673a2c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:27:55.925693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455cf51-6e3f-44bd-ad49-e0041673a2c7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:27:55.927086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455cf51-6e3f-44bd-ad49-e0041673a2c7 None admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:27:55.949393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 653/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:27:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:28:05.773740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=30 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:28:05.944838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:28:59.600525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2e2e-87fb-496d-a924-29bd1b814826 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:28:59.601629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2e2e-87fb-496d-a924-29bd1b814826 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:28:59.602138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a2e2e-87fb-496d-a924-29bd1b814826 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:28:59.609130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb3d9-bd66-4fae-9dca-23aa60fd2e3b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:28:59.610026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb3d9-bd66-4fae-9dca-23aa60fd2e3b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:28:59.610499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8fb3d9-bd66-4fae-9dca-23aa60fd2e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:28:59.615897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 654/1307] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:28:59 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:28:59.696082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9d8fb3d9-bd66-4fae-9dca-23aa60fd2e3b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:28:59.697903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9d8fb3d9-bd66-4fae-9dca-23aa60fd2e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:28:59.830438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 654/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:28:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:00.159076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf698-4df5-4403-9b6b-365abd8f3282 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:00.160053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf698-4df5-4403-9b6b-365abd8f3282 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:00.160544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbf698-4df5-4403-9b6b-365abd8f3282 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:00.162322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 655/1309] 10.222.0.48 () {54 vars in 963 bytes} [Sat Sep 17 03:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:00.174021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe88cfb-f804-435d-9502-56f40fa6d59c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:00.174409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe88cfb-f804-435d-9502-56f40fa6d59c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:00.174592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe88cfb-f804-435d-9502-56f40fa6d59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:00.286375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-efe88cfb-f804-435d-9502-56f40fa6d59c None None] MFA Rules not processed for user `18061b868be44122a849e2e239b56f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:00.287651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-efe88cfb-f804-435d-9502-56f40fa6d59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:00.309890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:00.378986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 655/1310] 10.222.0.48 () {58 vars in 1060 bytes} [Sat Sep 17 03:29:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:00.380009 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbf698-4df5-4403-9b6b-365abd8f3282 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:00.381825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-89dbf698-4df5-4403-9b6b-365abd8f3282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:00.504690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbf698-4df5-4403-9b6b-365abd8f3282 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:00.608538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae8270-f668-46ce-85a8-7091f2804479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:00.610097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae8270-f668-46ce-85a8-7091f2804479 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:00.610684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae8270-f668-46ce-85a8-7091f2804479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:00.611098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae8270-f668-46ce-85a8-7091f2804479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:00.612952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-96ae8270-f668-46ce-85a8-7091f2804479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:00.682822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:00.754169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae8270-f668-46ce-85a8-7091f2804479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:00.756157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae8270-f668-46ce-85a8-7091f2804479 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:00.778721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 656/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:03.234133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f511-d28c-4f94-9028-d6e146e5f850 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:03.234673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f511-d28c-4f94-9028-d6e146e5f850 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:03.234673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88f511-d28c-4f94-9028-d6e146e5f850 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:03.236111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 656/1312] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:03.241807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367cd72-7d77-4e77-bb85-b1092437a0bc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:03.242253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367cd72-7d77-4e77-bb85-b1092437a0bc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:03.242368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367cd72-7d77-4e77-bb85-b1092437a0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:03.327829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4367cd72-7d77-4e77-bb85-b1092437a0bc None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:03.329158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4367cd72-7d77-4e77-bb85-b1092437a0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:03.432348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 657/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:03.720537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88f511-d28c-4f94-9028-d6e146e5f850 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:03.723121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cb88f511-d28c-4f94-9028-d6e146e5f850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:03.838725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88f511-d28c-4f94-9028-d6e146e5f850 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:03.911451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:03.913745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fea4c-ddd8-4ffc-a574-6273523777b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:03.914395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fea4c-ddd8-4ffc-a574-6273523777b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:03.914869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fea4c-ddd8-4ffc-a574-6273523777b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:03.915207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fea4c-ddd8-4ffc-a574-6273523777b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:03.917156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-711fea4c-ddd8-4ffc-a574-6273523777b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:04.034891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fea4c-ddd8-4ffc-a574-6273523777b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:04.037052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711fea4c-ddd8-4ffc-a574-6273523777b6 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:04.056460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 657/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:06.476358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb200-d930-4ce5-a7c0-06ffdac6d27d None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:06.476971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb200-d930-4ce5-a7c0-06ffdac6d27d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:06.476971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb200-d930-4ce5-a7c0-06ffdac6d27d None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:06.478266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 658/1315] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:06.486289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823e3b-5587-411f-89e9-f8d5a53a8601 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:06.486742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823e3b-5587-411f-89e9-f8d5a53a8601 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:06.486836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f823e3b-5587-411f-89e9-f8d5a53a8601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:06.558490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7f823e3b-5587-411f-89e9-f8d5a53a8601 None None] MFA Rules not processed for user `f8365201de5f41589d4628aa197e5aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:06.559685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7f823e3b-5587-411f-89e9-f8d5a53a8601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:06.615171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:06.661518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 658/1316] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:06 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:29:06.942625 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bb200-d930-4ce5-a7c0-06ffdac6d27d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:06.945158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-419bb200-d930-4ce5-a7c0-06ffdac6d27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:06.960374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:07.059589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bb200-d930-4ce5-a7c0-06ffdac6d27d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:07.138530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1710a96e-4502-4b62-b393-72638561f303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:07.139124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a96e-4502-4b62-b393-72638561f303 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:07.139404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a96e-4502-4b62-b393-72638561f303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:07.139672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1710a96e-4502-4b62-b393-72638561f303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:07.141253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1710a96e-4502-4b62-b393-72638561f303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:07.209827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:07.259512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a96e-4502-4b62-b393-72638561f303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:07.260959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1710a96e-4502-4b62-b393-72638561f303 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:07.279747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 659/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:06 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:09.958256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877551-1d19-49e0-9c35-68a7e80f5df8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:09.958941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877551-1d19-49e0-9c35-68a7e80f5df8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:09.958941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16877551-1d19-49e0-9c35-68a7e80f5df8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:09.960182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 659/1318] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:09.965732 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b03eb-6e32-4d69-90a0-87061eb60da8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:09.966208 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b03eb-6e32-4d69-90a0-87061eb60da8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:09.966300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b03eb-6e32-4d69-90a0-87061eb60da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:10.035196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f38b03eb-6e32-4d69-90a0-87061eb60da8 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:10.036382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f38b03eb-6e32-4d69-90a0-87061eb60da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:10.133892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 660/1319] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:29:10.415903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877551-1d19-49e0-9c35-68a7e80f5df8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:10.418442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-16877551-1d19-49e0-9c35-68a7e80f5df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:10.538236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16877551-1d19-49e0-9c35-68a7e80f5df8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:10.633683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c36b4-5f1b-473c-ac35-42e8a222b4ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:10.634339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c36b4-5f1b-473c-ac35-42e8a222b4ac service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:10.634640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c36b4-5f1b-473c-ac35-42e8a222b4ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:10.634894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c36b4-5f1b-473c-ac35-42e8a222b4ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:10.637597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ef4c36b4-5f1b-473c-ac35-42e8a222b4ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:10.648621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:10.767623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c36b4-5f1b-473c-ac35-42e8a222b4ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:10.768983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c36b4-5f1b-473c-ac35-42e8a222b4ac service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:10.787748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 660/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:13.593880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbfbf-8995-4dff-a502-751c610b5baa None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:13.594412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbfbf-8995-4dff-a502-751c610b5baa None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:13.594412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fbfbf-8995-4dff-a502-751c610b5baa None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:13.595673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 661/1321] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:13.601092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa4093-5fa8-4bd2-9b12-15651e3c5e2f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:13.601528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa4093-5fa8-4bd2-9b12-15651e3c5e2f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:13.601782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa4093-5fa8-4bd2-9b12-15651e3c5e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:13.677803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7efa4093-5fa8-4bd2-9b12-15651e3c5e2f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:13.679114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7efa4093-5fa8-4bd2-9b12-15651e3c5e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:13.747573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:13.790116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 661/1322] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:14.066581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fbfbf-8995-4dff-a502-751c610b5baa None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:14.068260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2a1fbfbf-8995-4dff-a502-751c610b5baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:14.088814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:14.180023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fbfbf-8995-4dff-a502-751c610b5baa None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:14.253676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191c5bd0-5c2f-4a74-9c42-7bda6fd72c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:14.254211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c5bd0-5c2f-4a74-9c42-7bda6fd72c60 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:14.254482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c5bd0-5c2f-4a74-9c42-7bda6fd72c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:14.254747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191c5bd0-5c2f-4a74-9c42-7bda6fd72c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:14.256319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-191c5bd0-5c2f-4a74-9c42-7bda6fd72c60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:14.328456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:14.367618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c5bd0-5c2f-4a74-9c42-7bda6fd72c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:14.369066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191c5bd0-5c2f-4a74-9c42-7bda6fd72c60 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:14.386951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 662/1323] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:16.583416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a63e3-c74c-4e2f-ada5-94279eea099d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:16.583965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a63e3-c74c-4e2f-ada5-94279eea099d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:16.583965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a63e3-c74c-4e2f-ada5-94279eea099d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:16.585512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 662/1324] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:16.591110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788db0-c4e3-470a-96ab-c0060845e762 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:16.591521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788db0-c4e3-470a-96ab-c0060845e762 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:16.591775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a788db0-c4e3-470a-96ab-c0060845e762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:16.663671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3a788db0-c4e3-470a-96ab-c0060845e762 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:16.665122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3a788db0-c4e3-470a-96ab-c0060845e762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:16.764540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 663/1325] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:17.038913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a63e3-c74c-4e2f-ada5-94279eea099d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:17.040538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7c6a63e3-c74c-4e2f-ada5-94279eea099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:17.153549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a63e3-c74c-4e2f-ada5-94279eea099d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:17.227095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2921ad6b-f393-4e0a-aab1-c18be6ac3aa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:17.227705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ad6b-f393-4e0a-aab1-c18be6ac3aa6 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:17.227972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ad6b-f393-4e0a-aab1-c18be6ac3aa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:17.228236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2921ad6b-f393-4e0a-aab1-c18be6ac3aa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:17.229819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2921ad6b-f393-4e0a-aab1-c18be6ac3aa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:17.247404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:17.339900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921ad6b-f393-4e0a-aab1-c18be6ac3aa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:17.341354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2921ad6b-f393-4e0a-aab1-c18be6ac3aa6 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:17.359510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 663/1326] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:19.545306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb13ec-9333-4a0a-9ec6-e0634d10f7a4 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:19.545934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb13ec-9333-4a0a-9ec6-e0634d10f7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:19.545934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb13ec-9333-4a0a-9ec6-e0634d10f7a4 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:19.547242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 664/1327] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:19.552769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6793-f006-46e0-9f45-cd9885f20d12 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:19.553183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6793-f006-46e0-9f45-cd9885f20d12 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:19.553371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6793-f006-46e0-9f45-cd9885f20d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:19.623938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fbaa6793-f006-46e0-9f45-cd9885f20d12 None None] MFA Rules not processed for user `f8365201de5f41589d4628aa197e5aae`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:19.625169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fbaa6793-f006-46e0-9f45-cd9885f20d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:19.697373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:19.730679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 664/1328] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:20.008259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb13ec-9333-4a0a-9ec6-e0634d10f7a4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:20.009820 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f2cb13ec-9333-4a0a-9ec6-e0634d10f7a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:20.043260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:20.118094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb13ec-9333-4a0a-9ec6-e0634d10f7a4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:20.196163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59090452-df7c-494b-afbe-a18989cd317c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:20.196755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090452-df7c-494b-afbe-a18989cd317c service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:20.197062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090452-df7c-494b-afbe-a18989cd317c service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:20.197332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59090452-df7c-494b-afbe-a18989cd317c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:20.198982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-59090452-df7c-494b-afbe-a18989cd317c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:20.279375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:20.311330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59090452-df7c-494b-afbe-a18989cd317c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:20.312717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59090452-df7c-494b-afbe-a18989cd317c service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:20.331234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 665/1329] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:22.698297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869cc74-5f4b-4c8e-985d-cc3d9ad87375 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:22.699218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869cc74-5f4b-4c8e-985d-cc3d9ad87375 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:22.699218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869cc74-5f4b-4c8e-985d-cc3d9ad87375 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:22.701315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 665/1330] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:22.708326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6999-f8a7-4152-a4c2-4f56344e5cef None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:22.708777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6999-f8a7-4152-a4c2-4f56344e5cef None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:22.709007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d6999-f8a7-4152-a4c2-4f56344e5cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:22.776684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2a7d6999-f8a7-4152-a4c2-4f56344e5cef None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:22.777922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2a7d6999-f8a7-4152-a4c2-4f56344e5cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:22.879943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 666/1331] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:23.177241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b76f-3df2-4c59-99a0-2b6fd32e97fc None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:23.177550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b76f-3df2-4c59-99a0-2b6fd32e97fc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:23.177847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b76f-3df2-4c59-99a0-2b6fd32e97fc None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:23.179284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 666/1332] 10.222.0.48 () {54 vars in 963 bytes} [Sat Sep 17 03:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:23.187447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befa505-5374-4a44-a101-bb678340b8e1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:23.187767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befa505-5374-4a44-a101-bb678340b8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:23.188040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befa505-5374-4a44-a101-bb678340b8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:23.235666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:23.269506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0befa505-5374-4a44-a101-bb678340b8e1 None None] MFA Rules not processed for user `18061b868be44122a849e2e239b56f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:23.270813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0befa505-5374-4a44-a101-bb678340b8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:23.351721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 667/1333] 10.222.0.48 () {58 vars in 1060 bytes} [Sat Sep 17 03:29:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:23.360984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b76f-3df2-4c59-99a0-2b6fd32e97fc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:23.362935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5a46b76f-3df2-4c59-99a0-2b6fd32e97fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:23.474660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b76f-3df2-4c59-99a0-2b6fd32e97fc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:23.558433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9ea28-28e6-4637-b250-9da593937bf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:23.559242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ea28-28e6-4637-b250-9da593937bf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:23.559700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ea28-28e6-4637-b250-9da593937bf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:23.560082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9ea28-28e6-4637-b250-9da593937bf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:23.562736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-60e9ea28-28e6-4637-b250-9da593937bf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:23.592574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:23.678930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9ea28-28e6-4637-b250-9da593937bf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:23.680390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9ea28-28e6-4637-b250-9da593937bf4 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:23.698911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 667/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:26.095567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549f1a-f3ac-42a8-b01f-9d4d368e5040 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:26.096135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549f1a-f3ac-42a8-b01f-9d4d368e5040 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:26.096135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc549f1a-f3ac-42a8-b01f-9d4d368e5040 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:26.097452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 668/1335] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:26.103032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01cca-0e3a-46ab-b240-6ff7a63f9d70 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:26.103460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01cca-0e3a-46ab-b240-6ff7a63f9d70 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:26.103554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b01cca-0e3a-46ab-b240-6ff7a63f9d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:26.173865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f0b01cca-0e3a-46ab-b240-6ff7a63f9d70 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:26.175061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f0b01cca-0e3a-46ab-b240-6ff7a63f9d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:26.255197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:26.281786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 668/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:26.567789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549f1a-f3ac-42a8-b01f-9d4d368e5040 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:26.569338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bc549f1a-f3ac-42a8-b01f-9d4d368e5040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:26.685248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc549f1a-f3ac-42a8-b01f-9d4d368e5040 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:26.714549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:26.762360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd313-bb22-431f-bfad-9d0d24a934a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:26.762971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd313-bb22-431f-bfad-9d0d24a934a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:26.763245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd313-bb22-431f-bfad-9d0d24a934a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:26.763507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd313-bb22-431f-bfad-9d0d24a934a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:26.765105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b62cd313-bb22-431f-bfad-9d0d24a934a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:26.880651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd313-bb22-431f-bfad-9d0d24a934a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:26.882050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd313-bb22-431f-bfad-9d0d24a934a7 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:26.900230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 669/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:29.683205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7720-81c2-47f3-b015-b99ff51aa18a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:29.684164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7720-81c2-47f3-b015-b99ff51aa18a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:29.684164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db7720-81c2-47f3-b015-b99ff51aa18a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:29.686320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 669/1338] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:29.692366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a369b-6a59-41e8-99cc-f20ab09812d3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:29.692798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a369b-6a59-41e8-99cc-f20ab09812d3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:29.692889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a369b-6a59-41e8-99cc-f20ab09812d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:29.760492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-de8a369b-6a59-41e8-99cc-f20ab09812d3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:29.761707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-de8a369b-6a59-41e8-99cc-f20ab09812d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:29.770300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:29.862461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 670/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:30.145233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db7720-81c2-47f3-b015-b99ff51aa18a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:30.147685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-65db7720-81c2-47f3-b015-b99ff51aa18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:30.262525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db7720-81c2-47f3-b015-b99ff51aa18a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:30.341403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d492832-dda5-488d-acd8-b05af502faad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:30.342047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492832-dda5-488d-acd8-b05af502faad service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:30.342325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492832-dda5-488d-acd8-b05af502faad service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:30.342595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d492832-dda5-488d-acd8-b05af502faad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:30.344185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0d492832-dda5-488d-acd8-b05af502faad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:30.382480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:30.457900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d492832-dda5-488d-acd8-b05af502faad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:30.459313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d492832-dda5-488d-acd8-b05af502faad service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:30.477989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 670/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:34.699136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f49ba-223b-4752-875c-a4eeb6ef0d11 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:34.699735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f49ba-223b-4752-875c-a4eeb6ef0d11 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:34.699735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f49ba-223b-4752-875c-a4eeb6ef0d11 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:34.701050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 671/1341] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:34.706957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd8ac-f447-413b-bee3-4f4343435683 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:34.707619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd8ac-f447-413b-bee3-4f4343435683 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:34.707619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1bd8ac-f447-413b-bee3-4f4343435683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:34.779270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cb1bd8ac-f447-413b-bee3-4f4343435683 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:34.780488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cb1bd8ac-f447-413b-bee3-4f4343435683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:34.871717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:34.883453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 671/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:35.162099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f49ba-223b-4752-875c-a4eeb6ef0d11 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:35.163684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e26f49ba-223b-4752-875c-a4eeb6ef0d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:35.270770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f49ba-223b-4752-875c-a4eeb6ef0d11 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:35.309535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:35.347277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b493ac-dbc8-47e2-b081-b6d38bffa9d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:35.347882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b493ac-dbc8-47e2-b081-b6d38bffa9d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:35.348151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b493ac-dbc8-47e2-b081-b6d38bffa9d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:35.348414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b493ac-dbc8-47e2-b081-b6d38bffa9d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:35.350025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-64b493ac-dbc8-47e2-b081-b6d38bffa9d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:35.459498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b493ac-dbc8-47e2-b081-b6d38bffa9d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:35.460833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b493ac-dbc8-47e2-b081-b6d38bffa9d5 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:35.479378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 672/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:38.225373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3a832-9776-47cb-8b6c-1f8b5483522e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:38.225956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3a832-9776-47cb-8b6c-1f8b5483522e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:38.225956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3a832-9776-47cb-8b6c-1f8b5483522e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:38.227317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 672/1344] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:38.232637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eb62b-d93f-46ab-87f6-871fa7e0c9b1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:38.233087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eb62b-d93f-46ab-87f6-871fa7e0c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:38.233200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8eb62b-d93f-46ab-87f6-871fa7e0c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:38.299903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bb8eb62b-d93f-46ab-87f6-871fa7e0c9b1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:38.301163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bb8eb62b-d93f-46ab-87f6-871fa7e0c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:38.319411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:38.400189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 673/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:38.679000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3a832-9776-47cb-8b6c-1f8b5483522e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:38.680534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5fd3a832-9776-47cb-8b6c-1f8b5483522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:38.793092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3a832-9776-47cb-8b6c-1f8b5483522e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:38.872268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cd91d-8fcd-48e8-a144-0e3dc170aa73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:38.872783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd91d-8fcd-48e8-a144-0e3dc170aa73 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:38.873059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd91d-8fcd-48e8-a144-0e3dc170aa73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:38.873326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd91d-8fcd-48e8-a144-0e3dc170aa73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:38.874952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-054cd91d-8fcd-48e8-a144-0e3dc170aa73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:38.924188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:38.992229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cd91d-8fcd-48e8-a144-0e3dc170aa73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:38.993733 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cd91d-8fcd-48e8-a144-0e3dc170aa73 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:39.014054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 673/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:43.132957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aab49-f286-4011-9e94-8068e7415ff2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:43.133461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aab49-f286-4011-9e94-8068e7415ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:43.133461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3aab49-f286-4011-9e94-8068e7415ff2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:43.134903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 674/1347] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:43.140519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303e629-eb29-4256-99ed-099f9172f0d3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:43.140983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303e629-eb29-4256-99ed-099f9172f0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:43.141079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303e629-eb29-4256-99ed-099f9172f0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:43.208178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f303e629-eb29-4256-99ed-099f9172f0d3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:43.209394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f303e629-eb29-4256-99ed-099f9172f0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:43.310201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:43.313157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 674/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:43.591229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aab49-f286-4011-9e94-8068e7415ff2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:43.592856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2e3aab49-f286-4011-9e94-8068e7415ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:43.697312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3aab49-f286-4011-9e94-8068e7415ff2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:43.750099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:43.778943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90584a00-4409-49d5-bd19-2de843dc3332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:43.779546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584a00-4409-49d5-bd19-2de843dc3332 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:43.779821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584a00-4409-49d5-bd19-2de843dc3332 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:43.780088 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584a00-4409-49d5-bd19-2de843dc3332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:43.781690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90584a00-4409-49d5-bd19-2de843dc3332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:43.893790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90584a00-4409-49d5-bd19-2de843dc3332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:43.895218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90584a00-4409-49d5-bd19-2de843dc3332 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:43.914848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 675/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:29:48.772859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695fdb-b3a1-44ae-b7fd-7ccdd7844f54 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:48.773363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695fdb-b3a1-44ae-b7fd-7ccdd7844f54 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:48.774830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695fdb-b3a1-44ae-b7fd-7ccdd7844f54 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:48.778474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 675/1350] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:29:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:48.784108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d217-37e8-46cc-90a3-1c01f15eaf7e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:48.785687 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d217-37e8-46cc-90a3-1c01f15eaf7e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:48.786151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646d217-37e8-46cc-90a3-1c01f15eaf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:48.888496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5646d217-37e8-46cc-90a3-1c01f15eaf7e None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:48.889939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5646d217-37e8-46cc-90a3-1c01f15eaf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:48.917018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:49.074446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 676/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:29:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:53.108906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2d7a-48b7-4d69-b8d8-e6409bf369c9 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:53.110172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2d7a-48b7-4d69-b8d8-e6409bf369c9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:53.110462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2d7a-48b7-4d69-b8d8-e6409bf369c9 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:53.111980 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 676/1352] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:29:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:53.118073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007a656-be01-4c73-bc76-08b974aa0c0b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:53.118504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007a656-be01-4c73-bc76-08b974aa0c0b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:53.118653 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007a656-be01-4c73-bc76-08b974aa0c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:53.200412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f007a656-be01-4c73-bc76-08b974aa0c0b None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:53.201896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f007a656-be01-4c73-bc76-08b974aa0c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:53.279662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:53.330912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 677/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:29:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:54.805878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb52091-4f81-4874-9fe9-763b02a600ed None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:54.806456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb52091-4f81-4874-9fe9-763b02a600ed None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:54.806456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb52091-4f81-4874-9fe9-763b02a600ed None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:54.807749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 677/1354] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:54.812949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d20fe-6d0e-42a1-9f2c-5019c5f5afce None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:54.813383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d20fe-6d0e-42a1-9f2c-5019c5f5afce None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:54.813628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d20fe-6d0e-42a1-9f2c-5019c5f5afce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:54.892700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-599d20fe-6d0e-42a1-9f2c-5019c5f5afce None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:54.893921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-599d20fe-6d0e-42a1-9f2c-5019c5f5afce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:55.011402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 678/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:29:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:29:58.481925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae44cf-b901-4b86-a791-ff2fe24c3090 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:58.482508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae44cf-b901-4b86-a791-ff2fe24c3090 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:58.482670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae44cf-b901-4b86-a791-ff2fe24c3090 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:58.484697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 678/1356] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:29:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:58.490541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0895dd-8aec-4ae4-8662-6a0a50001490 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:58.491036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0895dd-8aec-4ae4-8662-6a0a50001490 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:58.491036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0895dd-8aec-4ae4-8662-6a0a50001490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:58.530269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:58.575322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bc0895dd-8aec-4ae4-8662-6a0a50001490 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:58.576671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bc0895dd-8aec-4ae4-8662-6a0a50001490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:58.681425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 679/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:29:58.992984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0464f9-e42f-4d66-b108-bc54b269f235 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:58.993283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0464f9-e42f-4d66-b108-bc54b269f235 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:58.993544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0464f9-e42f-4d66-b108-bc54b269f235 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:58.994932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 679/1358] 10.222.0.48 () {54 vars in 965 bytes} [Sat Sep 17 03:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:29:59.005928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67a2b-b1bb-4703-8137-c92abd44877e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:59.006462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67a2b-b1bb-4703-8137-c92abd44877e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:59.006771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c67a2b-b1bb-4703-8137-c92abd44877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:59.089071 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f3c67a2b-b1bb-4703-8137-c92abd44877e None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:29:59.090284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f3c67a2b-b1bb-4703-8137-c92abd44877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:59.141927 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:59.211662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 680/1359] 10.222.0.48 () {58 vars in 1062 bytes} [Sat Sep 17 03:29:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:29:59.219389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0464f9-e42f-4d66-b108-bc54b269f235 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:29:59.220964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fa0464f9-e42f-4d66-b108-bc54b269f235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:59.370989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0464f9-e42f-4d66-b108-bc54b269f235 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:29:59.445103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:29:59.492075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7859a77-c5ac-49ef-b624-90ea60f3a267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:29:59.492737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859a77-c5ac-49ef-b624-90ea60f3a267 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:29:59.492842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859a77-c5ac-49ef-b624-90ea60f3a267 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:29:59.493164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7859a77-c5ac-49ef-b624-90ea60f3a267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:29:59.494751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e7859a77-c5ac-49ef-b624-90ea60f3a267 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:29:59.590505 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7859a77-c5ac-49ef-b624-90ea60f3a267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:29:59.592120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7859a77-c5ac-49ef-b624-90ea60f3a267 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:29:59.611518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 680/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:01.965390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2f37-6712-4a15-8d89-af7be67f815e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:01.966015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2f37-6712-4a15-8d89-af7be67f815e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:01.966801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af2f37-6712-4a15-8d89-af7be67f815e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:01.981373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 681/1361] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:01 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:01.982527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af716da6-20a4-4384-92bb-2fd8c20dcce8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:01.982527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af716da6-20a4-4384-92bb-2fd8c20dcce8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:01.982527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af716da6-20a4-4384-92bb-2fd8c20dcce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:02.050602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-af716da6-20a4-4384-92bb-2fd8c20dcce8 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:02.052038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-af716da6-20a4-4384-92bb-2fd8c20dcce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:02.090916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:02.153296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 681/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:02.437952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af2f37-6712-4a15-8d89-af7be67f815e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:02.439491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a0af2f37-6712-4a15-8d89-af7be67f815e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:02.616134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af2f37-6712-4a15-8d89-af7be67f815e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:02.627067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:02.746645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de597e6-9281-4276-87a3-b079f7fa49b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:02.747257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de597e6-9281-4276-87a3-b079f7fa49b7 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:02.747534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de597e6-9281-4276-87a3-b079f7fa49b7 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:02.747809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de597e6-9281-4276-87a3-b079f7fa49b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:02.749425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9de597e6-9281-4276-87a3-b079f7fa49b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:02.838755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de597e6-9281-4276-87a3-b079f7fa49b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:02.840385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de597e6-9281-4276-87a3-b079f7fa49b7 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:02.859262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 682/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:05.326728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2094-de0b-4460-a9e9-5814309017c5 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:05.327312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2094-de0b-4460-a9e9-5814309017c5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:05.327312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec2094-de0b-4460-a9e9-5814309017c5 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:05.328554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 682/1364] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:05.334285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b76c9a-778d-4ec1-9168-1703f1c900b3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:05.334697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b76c9a-778d-4ec1-9168-1703f1c900b3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:05.334889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b76c9a-778d-4ec1-9168-1703f1c900b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:05.351928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:05.413930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d3b76c9a-778d-4ec1-9168-1703f1c900b3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:05.415158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3b76c9a-778d-4ec1-9168-1703f1c900b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:05.517703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 683/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:05.812263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b0677-0c43-46e5-9b50-dc589626e04d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:05.812552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b0677-0c43-46e5-9b50-dc589626e04d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:05.813103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b0677-0c43-46e5-9b50-dc589626e04d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:05.814446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 683/1366] 10.222.0.48 () {54 vars in 965 bytes} [Sat Sep 17 03:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:05.820182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda98aa-8e2d-479f-b014-5bba4be191d8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:05.820446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda98aa-8e2d-479f-b014-5bba4be191d8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:05.820885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda98aa-8e2d-479f-b014-5bba4be191d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:05.898641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4eda98aa-8e2d-479f-b014-5bba4be191d8 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:05.899852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4eda98aa-8e2d-479f-b014-5bba4be191d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:05.935303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:06.027734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 684/1367] 10.222.0.48 () {58 vars in 1062 bytes} [Sat Sep 17 03:30:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:06.035513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b0677-0c43-46e5-9b50-dc589626e04d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:06.037020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-971b0677-0c43-46e5-9b50-dc589626e04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:06.193993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b0677-0c43-46e5-9b50-dc589626e04d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:06.214955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:06.312977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff1212-f0b9-4b07-a8de-a50a438c2ff3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:06.313589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1212-f0b9-4b07-a8de-a50a438c2ff3 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:06.314020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1212-f0b9-4b07-a8de-a50a438c2ff3 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:06.314296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff1212-f0b9-4b07-a8de-a50a438c2ff3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:06.315879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c2ff1212-f0b9-4b07-a8de-a50a438c2ff3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:06.410682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff1212-f0b9-4b07-a8de-a50a438c2ff3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:06.412329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff1212-f0b9-4b07-a8de-a50a438c2ff3 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:06.433558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 684/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:06.547428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6b30-fee3-40f3-9ef9-0486bb2c70f8 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:06.548023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6b30-fee3-40f3-9ef9-0486bb2c70f8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:06.548023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa6b30-fee3-40f3-9ef9-0486bb2c70f8 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:06.549694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 685/1369] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:06.555326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147832b8-a96b-426d-b256-8e7d967b1aff None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:06.555893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147832b8-a96b-426d-b256-8e7d967b1aff None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:06.555893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147832b8-a96b-426d-b256-8e7d967b1aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:06.592673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:06.635229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-147832b8-a96b-426d-b256-8e7d967b1aff None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:06.636672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-147832b8-a96b-426d-b256-8e7d967b1aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:06.757615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 685/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:07.080262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c494b-75c5-4e20-9d2e-43d51e3cae32 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:07.080548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c494b-75c5-4e20-9d2e-43d51e3cae32 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:07.080818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c494b-75c5-4e20-9d2e-43d51e3cae32 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:07.082352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 686/1371] 10.222.0.48 () {54 vars in 964 bytes} [Sat Sep 17 03:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:07.087215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c69a-e557-4502-ac4a-84c11e2f69ec None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:07.087602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c69a-e557-4502-ac4a-84c11e2f69ec None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:07.087976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79c69a-e557-4502-ac4a-84c11e2f69ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:07.169222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2f79c69a-e557-4502-ac4a-84c11e2f69ec None None] MFA Rules not processed for user `0cd4b1beb0b149ceba9940a0631f23b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:07.170595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2f79c69a-e557-4502-ac4a-84c11e2f69ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:07.227382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:07.260270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 686/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Sat Sep 17 03:30:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:07.268452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c494b-75c5-4e20-9d2e-43d51e3cae32 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:07.270007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1c7c494b-75c5-4e20-9d2e-43d51e3cae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:07.382014 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c494b-75c5-4e20-9d2e-43d51e3cae32 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:07.438710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:07.478821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d24f66-5174-449a-a018-4846ac7500ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:07.479513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24f66-5174-449a-a018-4846ac7500ab service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:07.479683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24f66-5174-449a-a018-4846ac7500ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:07.479941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d24f66-5174-449a-a018-4846ac7500ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:07.481528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c6d24f66-5174-449a-a018-4846ac7500ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:07.599847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d24f66-5174-449a-a018-4846ac7500ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:07.601275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d24f66-5174-449a-a018-4846ac7500ab service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:07.621803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 687/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:08.680941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f3eb-149e-4f61-ba21-6ec162a8e7b3 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:08.681547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f3eb-149e-4f61-ba21-6ec162a8e7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:08.681547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4f3eb-149e-4f61-ba21-6ec162a8e7b3 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:08.682866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 687/1374] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:08.688453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b15b2-73af-422c-bf78-1aecbe60b0ec None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:08.688900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b15b2-73af-422c-bf78-1aecbe60b0ec None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:08.688992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b15b2-73af-422c-bf78-1aecbe60b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:08.755355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5b9b15b2-73af-422c-bf78-1aecbe60b0ec None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:08.756562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5b9b15b2-73af-422c-bf78-1aecbe60b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:08.777851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:08.861826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 688/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:30:09.144036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f3eb-149e-4f61-ba21-6ec162a8e7b3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:09.145627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5bd4f3eb-149e-4f61-ba21-6ec162a8e7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:09.303895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4f3eb-149e-4f61-ba21-6ec162a8e7b3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:09.356946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:09.420618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92978d48-e2f1-486d-9abd-50576a9e4d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:09.421376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978d48-e2f1-486d-9abd-50576a9e4d88 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:09.421704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978d48-e2f1-486d-9abd-50576a9e4d88 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:09.422000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92978d48-e2f1-486d-9abd-50576a9e4d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:09.423603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-92978d48-e2f1-486d-9abd-50576a9e4d88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:09.521104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92978d48-e2f1-486d-9abd-50576a9e4d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:09.522810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92978d48-e2f1-486d-9abd-50576a9e4d88 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:09.540918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 688/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:11.764106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502cff-0ee2-4b4c-9718-897152a77bb7 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:11.764614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502cff-0ee2-4b4c-9718-897152a77bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:11.765146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72502cff-0ee2-4b4c-9718-897152a77bb7 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:11.766656 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 689/1377] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:11.772352 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822c27-6296-46d0-ab6e-2531d397a5f2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:11.773253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822c27-6296-46d0-ab6e-2531d397a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:11.773896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822c27-6296-46d0-ab6e-2531d397a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:11.847112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-df822c27-6296-46d0-ab6e-2531d397a5f2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:11.848357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-df822c27-6296-46d0-ab6e-2531d397a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:11.857740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:11.961814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 689/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:12.244349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502cff-0ee2-4b4c-9718-897152a77bb7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:12.245893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-72502cff-0ee2-4b4c-9718-897152a77bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:12.402791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72502cff-0ee2-4b4c-9718-897152a77bb7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:12.407073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:12.524943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32535b-40d8-4159-aaf5-723a79b5f318 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:12.525480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32535b-40d8-4159-aaf5-723a79b5f318 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:12.525738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32535b-40d8-4159-aaf5-723a79b5f318 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:12.526042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32535b-40d8-4159-aaf5-723a79b5f318 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:12.527642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9a32535b-40d8-4159-aaf5-723a79b5f318 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:12.620940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32535b-40d8-4159-aaf5-723a79b5f318 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:12.622602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32535b-40d8-4159-aaf5-723a79b5f318 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:12.646417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 690/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:14.845993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218438e9-7786-411c-a84e-f33fee1ab82e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:14.846575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218438e9-7786-411c-a84e-f33fee1ab82e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:14.846575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218438e9-7786-411c-a84e-f33fee1ab82e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:14.853153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7215-5d55-48b2-a9d2-4fb16d39dd6f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:14.853584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7215-5d55-48b2-a9d2-4fb16d39dd6f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:14.853676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d7215-5d55-48b2-a9d2-4fb16d39dd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:14.858776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 690/1380] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:14.865735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:14.933693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ec3d7215-5d55-48b2-a9d2-4fb16d39dd6f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:14.935126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ec3d7215-5d55-48b2-a9d2-4fb16d39dd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:15.089982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 691/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:30:15.378855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218438e9-7786-411c-a84e-f33fee1ab82e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:15.380766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-218438e9-7786-411c-a84e-f33fee1ab82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:15.548476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:15.561816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218438e9-7786-411c-a84e-f33fee1ab82e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:15.704696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d56dd-53d8-4f95-bc99-e4fc38fd936e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:15.705681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d56dd-53d8-4f95-bc99-e4fc38fd936e service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:15.706125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d56dd-53d8-4f95-bc99-e4fc38fd936e service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:15.706743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d56dd-53d8-4f95-bc99-e4fc38fd936e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:15.709431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c66d56dd-53d8-4f95-bc99-e4fc38fd936e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:15.842711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d56dd-53d8-4f95-bc99-e4fc38fd936e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:15.845362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66d56dd-53d8-4f95-bc99-e4fc38fd936e service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:15.863822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:15.873420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 691/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:18.831805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0429ff-0fe4-403e-a951-1382bc4e22ce None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:18.832383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0429ff-0fe4-403e-a951-1382bc4e22ce None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:18.832482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0429ff-0fe4-403e-a951-1382bc4e22ce None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:18.834654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 692/1383] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:18.840924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793c13a-68ee-49e7-a608-cd50fa50dbdd None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:18.841621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793c13a-68ee-49e7-a608-cd50fa50dbdd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:18.841621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793c13a-68ee-49e7-a608-cd50fa50dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:18.932510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7793c13a-68ee-49e7-a608-cd50fa50dbdd None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:18.934225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7793c13a-68ee-49e7-a608-cd50fa50dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:19.047845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 692/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:19.337740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0429ff-0fe4-403e-a951-1382bc4e22ce None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:19.339381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2b0429ff-0fe4-403e-a951-1382bc4e22ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:19.440051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:19.506957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0429ff-0fe4-403e-a951-1382bc4e22ce None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:19.636349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4f7eb-4e28-4dd0-882a-89fe3df4adf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:19.637002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f7eb-4e28-4dd0-882a-89fe3df4adf3 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:19.637301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f7eb-4e28-4dd0-882a-89fe3df4adf3 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:19.637562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4f7eb-4e28-4dd0-882a-89fe3df4adf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:19.639356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-42a4f7eb-4e28-4dd0-882a-89fe3df4adf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:19.704626 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:19.765210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4f7eb-4e28-4dd0-882a-89fe3df4adf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:19.767475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4f7eb-4e28-4dd0-882a-89fe3df4adf3 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:19.787479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 693/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:22.035650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef7a4-81ad-4765-bd0c-4ed32e1c1033 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:22.036248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef7a4-81ad-4765-bd0c-4ed32e1c1033 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:22.036248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ef7a4-81ad-4765-bd0c-4ed32e1c1033 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:22.037637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 693/1386] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:22.043146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294ab4-b50e-4091-b523-93e71eeddb13 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:22.043645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294ab4-b50e-4091-b523-93e71eeddb13 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:22.043645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294ab4-b50e-4091-b523-93e71eeddb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:22.113907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-89294ab4-b50e-4091-b523-93e71eeddb13 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:22.115111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-89294ab4-b50e-4091-b523-93e71eeddb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:22.213934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 694/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:22.499670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef7a4-81ad-4765-bd0c-4ed32e1c1033 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:22.501256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4f7ef7a4-81ad-4765-bd0c-4ed32e1c1033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:22.580023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:22.651890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ef7a4-81ad-4765-bd0c-4ed32e1c1033 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:22.772364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdd562-ffbf-48e4-8063-1dea2da0192f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:22.772890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdd562-ffbf-48e4-8063-1dea2da0192f service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:22.773170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdd562-ffbf-48e4-8063-1dea2da0192f service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:22.773413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdd562-ffbf-48e4-8063-1dea2da0192f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:22.775065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-03bdd562-ffbf-48e4-8063-1dea2da0192f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:22.818650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:22.876750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdd562-ffbf-48e4-8063-1dea2da0192f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:22.878408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bdd562-ffbf-48e4-8063-1dea2da0192f service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:22.896955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 694/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:22.944041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643adc52-2985-4d96-9e08-2f774db7387f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:22.944322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643adc52-2985-4d96-9e08-2f774db7387f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:22.944592 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643adc52-2985-4d96-9e08-2f774db7387f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:22.945965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 695/1389] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:22.951898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017ccc-6fc3-40a2-bcf9-08587948b391 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:22.952258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017ccc-6fc3-40a2-bcf9-08587948b391 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:22.952536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee017ccc-6fc3-40a2-bcf9-08587948b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:23.033532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ee017ccc-6fc3-40a2-bcf9-08587948b391 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:23.034853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ee017ccc-6fc3-40a2-bcf9-08587948b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:23.144733 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 695/1390] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:23.439204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9890-66ef-4170-a92f-815d97dc5a55 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:23.439713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9890-66ef-4170-a92f-815d97dc5a55 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:23.439828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5e9890-66ef-4170-a92f-815d97dc5a55 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:23.441264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 696/1391] 10.222.0.48 () {54 vars in 962 bytes} [Sat Sep 17 03:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:23.446969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ec81-ba2b-4926-b220-e8188c9edb95 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:23.447254 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ec81-ba2b-4926-b220-e8188c9edb95 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:23.447518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c540ec81-ba2b-4926-b220-e8188c9edb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:23.466706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:23.531414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c540ec81-ba2b-4926-b220-e8188c9edb95 None None] MFA Rules not processed for user `c46c91e383f44555b753b6500c9cdc44`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:23.532611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c540ec81-ba2b-4926-b220-e8188c9edb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:23.610437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 696/1392] 10.222.0.48 () {58 vars in 1059 bytes} [Sat Sep 17 03:30:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:23.619961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9890-66ef-4170-a92f-815d97dc5a55 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:23.621419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-da5e9890-66ef-4170-a92f-815d97dc5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:23.653960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:23.731689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5e9890-66ef-4170-a92f-815d97dc5a55 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:23.808971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec841059-34e4-40f9-89ec-d9b75c7a601a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46c91e383f44555b753b6500c9cdc44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:23.809607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec841059-34e4-40f9-89ec-d9b75c7a601a service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:23.810016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec841059-34e4-40f9-89ec-d9b75c7a601a service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:23.810284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec841059-34e4-40f9-89ec-d9b75c7a601a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:23.812050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ec841059-34e4-40f9-89ec-d9b75c7a601a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:23.893248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:23.925541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec841059-34e4-40f9-89ec-d9b75c7a601a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:23.927032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec841059-34e4-40f9-89ec-d9b75c7a601a service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:23.945678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 697/1393] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:24.695675 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c27f-4ee2-44a7-8dd2-4f96ee810b3c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:24.696213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c27f-4ee2-44a7-8dd2-4f96ee810b3c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:24.696456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48c27f-4ee2-44a7-8dd2-4f96ee810b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:24.770010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9f48c27f-4ee2-44a7-8dd2-4f96ee810b3c None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:24.771319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9f48c27f-4ee2-44a7-8dd2-4f96ee810b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:24.831579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:24.872651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 697/1394] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:30:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:24.917175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404ef5-8c3d-40bc-a923-a1de480e84d1 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:24.918105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404ef5-8c3d-40bc-a923-a1de480e84d1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:24.918386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404ef5-8c3d-40bc-a923-a1de480e84d1 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:24.919908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 698/1395] 10.222.0.48 () {54 vars in 943 bytes} [Sat Sep 17 03:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:24.927023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9ab8-53d8-4353-b88d-dd29b8600cf5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:24.927318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9ab8-53d8-4353-b88d-dd29b8600cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:24.927591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d9ab8-53d8-4353-b88d-dd29b8600cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:25.022006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-547d9ab8-53d8-4353-b88d-dd29b8600cf5 None None] MFA Rules not processed for user `004e85a47ddd40f89d65bc5ffa817dc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:25.023219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-547d9ab8-53d8-4353-b88d-dd29b8600cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:25.101976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367cef-ce5a-48ef-87ef-93f0ca38172f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:25.102264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367cef-ce5a-48ef-87ef-93f0ca38172f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:25.102541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367cef-ce5a-48ef-87ef-93f0ca38172f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:25.103967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 699/1396] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:25.109499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c0427-39b3-414b-8048-b4e4214c0464 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:25.109813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c0427-39b3-414b-8048-b4e4214c0464 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:25.110091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c0427-39b3-414b-8048-b4e4214c0464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:25.134924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 698/1397] 10.222.0.48 () {58 vars in 1040 bytes} [Sat Sep 17 03:30:24 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:25.144713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9ab8-53d8-4353-b88d-dd29b8600cf5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:25.154274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d9ab8-53d8-4353-b88d-dd29b8600cf5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:25.177510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-428c0427-39b3-414b-8048-b4e4214c0464 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:25.178788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-428c0427-39b3-414b-8048-b4e4214c0464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:25.182396 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:25.264457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7149d1a-3522-469a-8f80-bbe9f77e45a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:25.265071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7149d1a-3522-469a-8f80-bbe9f77e45a9 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:25.265346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7149d1a-3522-469a-8f80-bbe9f77e45a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:25.265648 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7149d1a-3522-469a-8f80-bbe9f77e45a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:25.267324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c7149d1a-3522-469a-8f80-bbe9f77e45a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:25.282333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 700/1398] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:25.351142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7149d1a-3522-469a-8f80-bbe9f77e45a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:25.352757 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7149d1a-3522-469a-8f80-bbe9f77e45a9 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:25.361440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 699/1399] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:30:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 03:30:25.564326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c0427-39b3-414b-8048-b4e4214c0464 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:25.565550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-428c0427-39b3-414b-8048-b4e4214c0464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:25.608570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:25.689099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c0427-39b3-414b-8048-b4e4214c0464 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:25.816348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7aff1-6d69-4b6b-9ec1-987f15d61889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:25.817136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7aff1-6d69-4b6b-9ec1-987f15d61889 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:25.817411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7aff1-6d69-4b6b-9ec1-987f15d61889 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:25.817682 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7aff1-6d69-4b6b-9ec1-987f15d61889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:25.819330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d0d7aff1-6d69-4b6b-9ec1-987f15d61889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:25.856563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:25.919626 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7aff1-6d69-4b6b-9ec1-987f15d61889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:25.921512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7aff1-6d69-4b6b-9ec1-987f15d61889 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:25.940267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 701/1400] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:28.150612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867c4b-9a3e-48fe-aaa9-1ccec2c357ba None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:28.151168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867c4b-9a3e-48fe-aaa9-1ccec2c357ba None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:28.151168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42867c4b-9a3e-48fe-aaa9-1ccec2c357ba None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:28.152514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 700/1401] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:28.158131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e181a-9aef-4bda-9353-9b08aa859d34 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:28.158542 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e181a-9aef-4bda-9353-9b08aa859d34 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:28.158667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e181a-9aef-4bda-9353-9b08aa859d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:28.232525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d97e181a-9aef-4bda-9353-9b08aa859d34 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:28.234138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d97e181a-9aef-4bda-9353-9b08aa859d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:28.343966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 702/1402] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:28.630358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867c4b-9a3e-48fe-aaa9-1ccec2c357ba None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:28.632015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-42867c4b-9a3e-48fe-aaa9-1ccec2c357ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:28.698185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:28.800048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42867c4b-9a3e-48fe-aaa9-1ccec2c357ba None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:28.977092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44353d93-f528-413d-82c0-22bb16359776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:28.977734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353d93-f528-413d-82c0-22bb16359776 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:28.978067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353d93-f528-413d-82c0-22bb16359776 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:28.978345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44353d93-f528-413d-82c0-22bb16359776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:28.980117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-44353d93-f528-413d-82c0-22bb16359776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:29.006030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:29.091995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44353d93-f528-413d-82c0-22bb16359776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:29.093653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44353d93-f528-413d-82c0-22bb16359776 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:29.120973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 701/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:31.311295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb0a8-9f74-4816-989b-b2d4cd530cd5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:31.311876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb0a8-9f74-4816-989b-b2d4cd530cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:31.311876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfb0a8-9f74-4816-989b-b2d4cd530cd5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:31.317848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 703/1404] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:31.320052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62ec4-bdc9-43b7-a4df-ff7c9240981f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:31.320509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62ec4-bdc9-43b7-a4df-ff7c9240981f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:31.320694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e62ec4-bdc9-43b7-a4df-ff7c9240981f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:31.431850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-03e62ec4-bdc9-43b7-a4df-ff7c9240981f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:31.433256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-03e62ec4-bdc9-43b7-a4df-ff7c9240981f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:31.550931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:31.569904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 702/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:31.856873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfb0a8-9f74-4816-989b-b2d4cd530cd5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:31.859259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d1bfb0a8-9f74-4816-989b-b2d4cd530cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:31.869526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:32.048812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfb0a8-9f74-4816-989b-b2d4cd530cd5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:32.147004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:32.184655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbb370-032a-46a4-b93f-33dd06617152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:32.185285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb370-032a-46a4-b93f-33dd06617152 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:32.185564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb370-032a-46a4-b93f-33dd06617152 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:32.186048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbb370-032a-46a4-b93f-33dd06617152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:32.188097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3bfbb370-032a-46a4-b93f-33dd06617152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:32.293696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbb370-032a-46a4-b93f-33dd06617152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:32.295357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbb370-032a-46a4-b93f-33dd06617152 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:32.315241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 704/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:34.589028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dfd27-2e8d-456b-90e7-28939613593b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:34.590141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dfd27-2e8d-456b-90e7-28939613593b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:34.590349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dfd27-2e8d-456b-90e7-28939613593b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:34.595704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 703/1407] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:34.599094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0bc08-6637-45d4-9ebd-835ca5b69dc6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:34.599596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0bc08-6637-45d4-9ebd-835ca5b69dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:34.599899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0bc08-6637-45d4-9ebd-835ca5b69dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:34.708926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c4e0bc08-6637-45d4-9ebd-835ca5b69dc6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:34.711212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c4e0bc08-6637-45d4-9ebd-835ca5b69dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:34.784457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:34.861836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 705/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:30:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:35.136514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dfd27-2e8d-456b-90e7-28939613593b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:35.138257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-864dfd27-2e8d-456b-90e7-28939613593b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:35.325106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dfd27-2e8d-456b-90e7-28939613593b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:35.425370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:35.616407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95589d36-f605-40e5-821e-ce1fd95dae3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:35.617094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95589d36-f605-40e5-821e-ce1fd95dae3f service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:35.617277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95589d36-f605-40e5-821e-ce1fd95dae3f service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:35.617545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95589d36-f605-40e5-821e-ce1fd95dae3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:35.619175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-95589d36-f605-40e5-821e-ce1fd95dae3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:35.741062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95589d36-f605-40e5-821e-ce1fd95dae3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:35.742923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95589d36-f605-40e5-821e-ce1fd95dae3f service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:35.769350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 704/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:44.845266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=23 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:45.765038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=64 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:48.630939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468ae8-f0b2-4978-b2ed-ef58094ed3cc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:48.631520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468ae8-f0b2-4978-b2ed-ef58094ed3cc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:48.631520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65468ae8-f0b2-4978-b2ed-ef58094ed3cc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:48.632904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 706/1410] 10.222.0.48 () {54 vars in 918 bytes} [Sat Sep 17 03:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:48.638429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3cb9f-e3e7-4d96-ba54-e71641cfca5e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:48.638913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3cb9f-e3e7-4d96-ba54-e71641cfca5e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:48.639022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3cb9f-e3e7-4d96-ba54-e71641cfca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:48.719560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-42e3cb9f-e3e7-4d96-ba54-e71641cfca5e None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:48.720785 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-42e3cb9f-e3e7-4d96-ba54-e71641cfca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:48.832970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 705/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Sat Sep 17 03:30:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:48.847749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ffad8-ebdd-4f45-a285-cfea5a9198f9 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:48.848068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ffad8-ebdd-4f45-a285-cfea5a9198f9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:48.848400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ffad8-ebdd-4f45-a285-cfea5a9198f9 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:48.849780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 707/1412] 10.222.0.48 () {54 vars in 918 bytes} [Sat Sep 17 03:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:48.855007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44240c-3087-42d0-be01-9b3574ca8246 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:48.855275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44240c-3087-42d0-be01-9b3574ca8246 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:48.855543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44240c-3087-42d0-be01-9b3574ca8246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:48.935089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:48.939169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6d44240c-3087-42d0-be01-9b3574ca8246 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:48.940933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6d44240c-3087-42d0-be01-9b3574ca8246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:49.060303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 706/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Sat Sep 17 03:30:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:30:51.648309 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021acf2-e53e-425f-b67e-267c3f9b5478 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:51.648896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021acf2-e53e-425f-b67e-267c3f9b5478 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:51.648896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021acf2-e53e-425f-b67e-267c3f9b5478 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:51.650166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:51.656735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0a72-d579-47c3-a888-fd69920d3311 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:51.657506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0a72-d579-47c3-a888-fd69920d3311 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:51.657658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82f0a72-d579-47c3-a888-fd69920d3311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:51.734738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b82f0a72-d579-47c3-a888-fd69920d3311 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:51.736297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b82f0a72-d579-47c3-a888-fd69920d3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:51.796686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:51.841570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:52.131297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021acf2-e53e-425f-b67e-267c3f9b5478 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:52.132967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a021acf2-e53e-425f-b67e-267c3f9b5478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:52.284850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021acf2-e53e-425f-b67e-267c3f9b5478 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:52.370822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:52.415643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc9068-274b-4496-8041-bea400a6293f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:52.416249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9068-274b-4496-8041-bea400a6293f service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:52.416519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9068-274b-4496-8041-bea400a6293f service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:52.416790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc9068-274b-4496-8041-bea400a6293f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:52.418404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dedc9068-274b-4496-8041-bea400a6293f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:52.510108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc9068-274b-4496-8041-bea400a6293f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:52.511707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc9068-274b-4496-8041-bea400a6293f service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:52.529540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 709/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:53.685738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcfb1b-18c4-4a85-a952-2223466dce68 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:53.686368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcfb1b-18c4-4a85-a952-2223466dce68 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:53.686368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bcfb1b-18c4-4a85-a952-2223466dce68 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:53.687600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:53.694602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e1a4-7361-4434-8a84-66a47d56445c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:53.695072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e1a4-7361-4434-8a84-66a47d56445c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:53.695177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2e1a4-7361-4434-8a84-66a47d56445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:53.782252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-04b2e1a4-7361-4434-8a84-66a47d56445c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:53.783485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-04b2e1a4-7361-4434-8a84-66a47d56445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:53.811884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:53.883748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:30:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:54.032940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcfb1b-18c4-4a85-a952-2223466dce68 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:54.035439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-93bcfb1b-18c4-4a85-a952-2223466dce68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:54.195529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bcfb1b-18c4-4a85-a952-2223466dce68 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:54.239734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:54.316958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1d91-16e8-466e-a973-e7ee9f0af54e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:54.317582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1d91-16e8-466e-a973-e7ee9f0af54e service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:54.317889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1d91-16e8-466e-a973-e7ee9f0af54e service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:54.318149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1d91-16e8-466e-a973-e7ee9f0af54e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:54.319805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2fad1d91-16e8-466e-a973-e7ee9f0af54e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:54.410986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1d91-16e8-466e-a973-e7ee9f0af54e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:54.412682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1d91-16e8-466e-a973-e7ee9f0af54e service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:54.430723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 709/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:55.567303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3395b88-f29f-4e34-b852-f1985e2afbd5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:55.568255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3395b88-f29f-4e34-b852-f1985e2afbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:55.568255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3395b88-f29f-4e34-b852-f1985e2afbd5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:55.570445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:30:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:55.576975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556053-a9c0-40ff-9e1e-118fa0a11b10 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:55.577432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556053-a9c0-40ff-9e1e-118fa0a11b10 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:55.577541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b556053-a9c0-40ff-9e1e-118fa0a11b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:55.632612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:55.658361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2b556053-a9c0-40ff-9e1e-118fa0a11b10 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:55.659501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2b556053-a9c0-40ff-9e1e-118fa0a11b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:55.766836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:30:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:55.919025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3395b88-f29f-4e34-b852-f1985e2afbd5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:55.920463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3395b88-f29f-4e34-b852-f1985e2afbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:56.086339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3395b88-f29f-4e34-b852-f1985e2afbd5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:56.099195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:56.209012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03094a05-b4bd-4b0d-a150-8703ae653de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:56.209515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03094a05-b4bd-4b0d-a150-8703ae653de9 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:56.209913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03094a05-b4bd-4b0d-a150-8703ae653de9 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:56.210174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03094a05-b4bd-4b0d-a150-8703ae653de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:56.211751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-03094a05-b4bd-4b0d-a150-8703ae653de9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:56.312329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03094a05-b4bd-4b0d-a150-8703ae653de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:56.313971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03094a05-b4bd-4b0d-a150-8703ae653de9 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:56.333259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 712/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:57.448223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342db8c-cb3f-4edb-96a5-b90aa7d6921e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:57.448999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342db8c-cb3f-4edb-96a5-b90aa7d6921e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:57.449213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342db8c-cb3f-4edb-96a5-b90aa7d6921e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:57.451336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:30:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:57.462256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa51e-bfd7-4be0-9a3d-f34b754faaa8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:57.462720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa51e-bfd7-4be0-9a3d-f34b754faaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:57.463164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fa51e-bfd7-4be0-9a3d-f34b754faaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:57.489155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:57.548265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c77fa51e-bfd7-4be0-9a3d-f34b754faaa8 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:57.549469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c77fa51e-bfd7-4be0-9a3d-f34b754faaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:57.654960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:57.806958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342db8c-cb3f-4edb-96a5-b90aa7d6921e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:57.809623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8342db8c-cb3f-4edb-96a5-b90aa7d6921e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:57.932831 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:57.969103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342db8c-cb3f-4edb-96a5-b90aa7d6921e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:58.090081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8723a-a015-446a-8b87-fe657bae6cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:58.090687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8723a-a015-446a-8b87-fe657bae6cd8 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:58.090958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8723a-a015-446a-8b87-fe657bae6cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:58.091217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8723a-a015-446a-8b87-fe657bae6cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:58.092745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e3b8723a-a015-446a-8b87-fe657bae6cd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:58.170201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:58.185347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8723a-a015-446a-8b87-fe657bae6cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:30:58.187734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8723a-a015-446a-8b87-fe657bae6cd8 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:30:58.209100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 712/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:30:59.336999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954f4e8-fcd0-4e37-89e8-fe59604fcb3e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:59.337560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954f4e8-fcd0-4e37-89e8-fe59604fcb3e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:59.337560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954f4e8-fcd0-4e37-89e8-fe59604fcb3e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:59.338870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:30:59.345454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc774d3f-b6a4-432f-847a-8ff21409ee00 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:59.345940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc774d3f-b6a4-432f-847a-8ff21409ee00 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:59.346061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc774d3f-b6a4-432f-847a-8ff21409ee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:59.430391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dc774d3f-b6a4-432f-847a-8ff21409ee00 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:30:59.431608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dc774d3f-b6a4-432f-847a-8ff21409ee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:59.531328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:30:59.684555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954f4e8-fcd0-4e37-89e8-fe59604fcb3e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:30:59.687056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0954f4e8-fcd0-4e37-89e8-fe59604fcb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:30:59.775883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:30:59.838405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954f4e8-fcd0-4e37-89e8-fe59604fcb3e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:30:59.958003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63830e7-1021-4dfe-932e-299d4775d2ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:30:59.958490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63830e7-1021-4dfe-932e-299d4775d2ba service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:30:59.958758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63830e7-1021-4dfe-932e-299d4775d2ba service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:30:59.959026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63830e7-1021-4dfe-932e-299d4775d2ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:30:59.960673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f63830e7-1021-4dfe-932e-299d4775d2ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:00.010827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:00.053376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63830e7-1021-4dfe-932e-299d4775d2ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:00.055097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63830e7-1021-4dfe-932e-299d4775d2ba service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:00.073456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 715/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:30:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:01.125874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6976c7-287f-461d-963d-f11c628fc47d None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:01.126417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6976c7-287f-461d-963d-f11c628fc47d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:01.126417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6976c7-287f-461d-963d-f11c628fc47d None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:01.128445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:31:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:01.136861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a917b-9856-4e12-8d30-1806c9d28bfd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:01.137280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a917b-9856-4e12-8d30-1806c9d28bfd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:01.137399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a917b-9856-4e12-8d30-1806c9d28bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:01.219848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ad7a917b-9856-4e12-8d30-1806c9d28bfd None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:01.221650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ad7a917b-9856-4e12-8d30-1806c9d28bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:01.338153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:31:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:01.493582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6976c7-287f-461d-963d-f11c628fc47d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:01.495966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6c6976c7-287f-461d-963d-f11c628fc47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:01.557559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:01.664365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6976c7-287f-461d-963d-f11c628fc47d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:01.786524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb929b-428b-4349-be7e-52c27781f121 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:01.787139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb929b-428b-4349-be7e-52c27781f121 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:01.787416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb929b-428b-4349-be7e-52c27781f121 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:01.787682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb929b-428b-4349-be7e-52c27781f121 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:01.789323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-41bb929b-428b-4349-be7e-52c27781f121 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:01.796143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:01.880448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb929b-428b-4349-be7e-52c27781f121 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:01.882107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bb929b-428b-4349-be7e-52c27781f121 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:01.901933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 715/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:02.942424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820922-1180-427d-8280-99ec7026b252 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:02.943006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820922-1180-427d-8280-99ec7026b252 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:02.943006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32820922-1180-427d-8280-99ec7026b252 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:02.944321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:02.951768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b966d1-5883-4fac-9b56-10f83be56918 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:02.952251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b966d1-5883-4fac-9b56-10f83be56918 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:02.952364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b966d1-5883-4fac-9b56-10f83be56918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:03.038696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-49b966d1-5883-4fac-9b56-10f83be56918 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:03.039914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-49b966d1-5883-4fac-9b56-10f83be56918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:03.108369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:03.139000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:31:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:03.291765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32820922-1180-427d-8280-99ec7026b252 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:03.293207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-32820922-1180-427d-8280-99ec7026b252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:03.312194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:03.452179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32820922-1180-427d-8280-99ec7026b252 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:03.553879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:03.580367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917865b2-5f2e-4923-a4b7-bef814153662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:03.580972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917865b2-5f2e-4923-a4b7-bef814153662 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:03.581241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917865b2-5f2e-4923-a4b7-bef814153662 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:03.581508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917865b2-5f2e-4923-a4b7-bef814153662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:03.583113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-917865b2-5f2e-4923-a4b7-bef814153662 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:03.673937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917865b2-5f2e-4923-a4b7-bef814153662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:03.675539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917865b2-5f2e-4923-a4b7-bef814153662 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:03.693901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 718/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:04.749874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cce7-b518-4380-af7c-777f37ad8c65 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:04.750468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cce7-b518-4380-af7c-777f37ad8c65 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:04.750468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031cce7-b518-4380-af7c-777f37ad8c65 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:04.751946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:04.758499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2e86-f973-4d20-8595-a565c5432e5f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:04.759011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2e86-f973-4d20-8595-a565c5432e5f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:04.759128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c2e86-f973-4d20-8595-a565c5432e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:04.836261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-311c2e86-f973-4d20-8595-a565c5432e5f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:04.837397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-311c2e86-f973-4d20-8595-a565c5432e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:04.881703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:04.944883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:05.106351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031cce7-b518-4380-af7c-777f37ad8c65 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:05.107788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e031cce7-b518-4380-af7c-777f37ad8c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:05.275119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031cce7-b518-4380-af7c-777f37ad8c65 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:05.334967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:05.397607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a65b1-2dd3-41bf-b1eb-0179048f4659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:05.398279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a65b1-2dd3-41bf-b1eb-0179048f4659 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:05.398511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a65b1-2dd3-41bf-b1eb-0179048f4659 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:05.398766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a65b1-2dd3-41bf-b1eb-0179048f4659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:05.400356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7e0a65b1-2dd3-41bf-b1eb-0179048f4659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:05.493919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a65b1-2dd3-41bf-b1eb-0179048f4659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:05.495528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a65b1-2dd3-41bf-b1eb-0179048f4659 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:05.514165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 718/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:06.569709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27581b-49c5-4660-985f-be99bdd0bf0b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:06.570716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27581b-49c5-4660-985f-be99bdd0bf0b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:06.570716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27581b-49c5-4660-985f-be99bdd0bf0b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:06.572793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:31:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:06.581584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0c343-7397-46aa-b131-dbf9ba564a85 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:06.582150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0c343-7397-46aa-b131-dbf9ba564a85 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:06.582150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0c343-7397-46aa-b131-dbf9ba564a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:06.665247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2da0c343-7397-46aa-b131-dbf9ba564a85 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:06.666507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2da0c343-7397-46aa-b131-dbf9ba564a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:06.668568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:06.775871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:06.928120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27581b-49c5-4660-985f-be99bdd0bf0b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:06.930596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7b27581b-49c5-4660-985f-be99bdd0bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:07.096100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27581b-49c5-4660-985f-be99bdd0bf0b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:07.127084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:07.222683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50eb45-5bf0-42e1-982c-177e28fc86a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:07.223233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50eb45-5bf0-42e1-982c-177e28fc86a5 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:07.223501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50eb45-5bf0-42e1-982c-177e28fc86a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:07.223765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50eb45-5bf0-42e1-982c-177e28fc86a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:07.225345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1b50eb45-5bf0-42e1-982c-177e28fc86a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:07.316021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50eb45-5bf0-42e1-982c-177e28fc86a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:07.317613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b50eb45-5bf0-42e1-982c-177e28fc86a5 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:07.336185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 721/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:09.378003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dfd30-2b34-40cd-9f0f-05eaa2eb4074 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:09.378893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dfd30-2b34-40cd-9f0f-05eaa2eb4074 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:09.378893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dfd30-2b34-40cd-9f0f-05eaa2eb4074 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:09.380840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:09.387066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c449ed-cf13-410d-b915-c287a44efb82 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:09.387534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c449ed-cf13-410d-b915-c287a44efb82 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:09.387646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c449ed-cf13-410d-b915-c287a44efb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:09.430164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:09.456129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-74c449ed-cf13-410d-b915-c287a44efb82 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:09.457339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-74c449ed-cf13-410d-b915-c287a44efb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:09.566090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:09.847172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dfd30-2b34-40cd-9f0f-05eaa2eb4074 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:09.849804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ca5dfd30-2b34-40cd-9f0f-05eaa2eb4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:09.965569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dfd30-2b34-40cd-9f0f-05eaa2eb4074 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:09.999189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:10.040868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f3b33-1827-4b58-8abf-0199ca988d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:10.041471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f3b33-1827-4b58-8abf-0199ca988d40 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:10.041745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f3b33-1827-4b58-8abf-0199ca988d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:10.042016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f3b33-1827-4b58-8abf-0199ca988d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:10.043668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-be0f3b33-1827-4b58-8abf-0199ca988d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:10.153976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f3b33-1827-4b58-8abf-0199ca988d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:10.155440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f3b33-1827-4b58-8abf-0199ca988d40 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:10.174017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 721/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:12.464823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f820258-707f-4bfa-bfb2-8ad42da164f2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:12.465394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f820258-707f-4bfa-bfb2-8ad42da164f2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:12.465394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f820258-707f-4bfa-bfb2-8ad42da164f2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:12.466790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:12.475192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42386ff9-f405-4ce3-af61-8370d2f5bec0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:12.475627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42386ff9-f405-4ce3-af61-8370d2f5bec0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:12.475747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42386ff9-f405-4ce3-af61-8370d2f5bec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:12.547809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-42386ff9-f405-4ce3-af61-8370d2f5bec0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:12.549696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-42386ff9-f405-4ce3-af61-8370d2f5bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:12.571095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:12.660049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:12.953264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f820258-707f-4bfa-bfb2-8ad42da164f2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:12.955730 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4f820258-707f-4bfa-bfb2-8ad42da164f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:13.077026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f820258-707f-4bfa-bfb2-8ad42da164f2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:13.092380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:13.160554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19303ff-a98d-4156-9730-5929f2765589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:13.161152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19303ff-a98d-4156-9730-5929f2765589 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:13.161427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19303ff-a98d-4156-9730-5929f2765589 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:13.161690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19303ff-a98d-4156-9730-5929f2765589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:13.163307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c19303ff-a98d-4156-9730-5929f2765589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:13.282366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19303ff-a98d-4156-9730-5929f2765589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:13.283748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19303ff-a98d-4156-9730-5929f2765589 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:13.302640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 724/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:15.771673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1fbc-532d-4505-b42c-4d86c47b8b6c None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:15.772540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1fbc-532d-4505-b42c-4d86c47b8b6c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:15.772540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ace1fbc-532d-4505-b42c-4d86c47b8b6c None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:15.774651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:15.780179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702809c5-ac44-4e55-9a81-3b3e2ba5b60b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:15.780615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702809c5-ac44-4e55-9a81-3b3e2ba5b60b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:15.780711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702809c5-ac44-4e55-9a81-3b3e2ba5b60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:15.830209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:15.853453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-702809c5-ac44-4e55-9a81-3b3e2ba5b60b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:15.854756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-702809c5-ac44-4e55-9a81-3b3e2ba5b60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:15.957432 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:16.243155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1fbc-532d-4505-b42c-4d86c47b8b6c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:16.246149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8ace1fbc-532d-4505-b42c-4d86c47b8b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:16.360612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ace1fbc-532d-4505-b42c-4d86c47b8b6c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:16.406725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:16.444201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96205b05-98f8-4d48-9972-d6de2878b1f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:16.444814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205b05-98f8-4d48-9972-d6de2878b1f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:16.445092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205b05-98f8-4d48-9972-d6de2878b1f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:16.445367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96205b05-98f8-4d48-9972-d6de2878b1f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:16.446994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-96205b05-98f8-4d48-9972-d6de2878b1f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:16.577132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96205b05-98f8-4d48-9972-d6de2878b1f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:16.578551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96205b05-98f8-4d48-9972-d6de2878b1f5 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:16.599725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 724/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:18.924787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5a92-cfbc-42f4-afbb-5df9506a266b None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:18.925399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5a92-cfbc-42f4-afbb-5df9506a266b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:18.925399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c5a92-cfbc-42f4-afbb-5df9506a266b None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:18.926731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:18.933200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4e04-7e41-40b3-90fa-98385ddc8521 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:18.934013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4e04-7e41-40b3-90fa-98385ddc8521 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:18.934164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c4e04-7e41-40b3-90fa-98385ddc8521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:19.005781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8e1c4e04-7e41-40b3-90fa-98385ddc8521 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:19.007020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8e1c4e04-7e41-40b3-90fa-98385ddc8521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:19.028277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:19.110022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:19.393103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c5a92-cfbc-42f4-afbb-5df9506a266b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:19.395662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b57c5a92-cfbc-42f4-afbb-5df9506a266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:19.507942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c5a92-cfbc-42f4-afbb-5df9506a266b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:19.528750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:19.600790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35704483-fe3c-4859-a8e9-9d3c58e80321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:19.601401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704483-fe3c-4859-a8e9-9d3c58e80321 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:19.601683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704483-fe3c-4859-a8e9-9d3c58e80321 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:19.602006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35704483-fe3c-4859-a8e9-9d3c58e80321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:19.603664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-35704483-fe3c-4859-a8e9-9d3c58e80321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:19.718456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35704483-fe3c-4859-a8e9-9d3c58e80321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:19.719812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35704483-fe3c-4859-a8e9-9d3c58e80321 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:19.739163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 727/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:21.908866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6636bb9-8ce8-409b-b1ab-b92ffa4fec07 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:21.909725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6636bb9-8ce8-409b-b1ab-b92ffa4fec07 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:21.909725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6636bb9-8ce8-409b-b1ab-b92ffa4fec07 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:21.911790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:21.917533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8985-5ee2-4a83-bb1b-bcb5da8992e9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:21.918005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8985-5ee2-4a83-bb1b-bcb5da8992e9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:21.918111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef8985-5ee2-4a83-bb1b-bcb5da8992e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:21.983160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:21.986067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5bef8985-5ee2-4a83-bb1b-bcb5da8992e9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:21.987767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5bef8985-5ee2-4a83-bb1b-bcb5da8992e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:22.089573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:31:22.376328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6636bb9-8ce8-409b-b1ab-b92ffa4fec07 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:22.377995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b6636bb9-8ce8-409b-b1ab-b92ffa4fec07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:22.488254 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6636bb9-8ce8-409b-b1ab-b92ffa4fec07 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:22.540731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:22.568777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13def9d-6cd1-4a0b-a7d0-cbd8a8fa8cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:22.569666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13def9d-6cd1-4a0b-a7d0-cbd8a8fa8cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:22.570086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13def9d-6cd1-4a0b-a7d0-cbd8a8fa8cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:22.570456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13def9d-6cd1-4a0b-a7d0-cbd8a8fa8cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:22.572917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d13def9d-6cd1-4a0b-a7d0-cbd8a8fa8cd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:22.690999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13def9d-6cd1-4a0b-a7d0-cbd8a8fa8cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:22.692459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13def9d-6cd1-4a0b-a7d0-cbd8a8fa8cd6 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:22.712584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 727/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:24.943608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c12ce7-4b6a-4566-ba12-30bc0d65f0c3 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:24.944351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c12ce7-4b6a-4566-ba12-30bc0d65f0c3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:24.944351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c12ce7-4b6a-4566-ba12-30bc0d65f0c3 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:24.946086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:24.954180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d0716-4d55-4d4d-8e1a-06982a79c321 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:24.954646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d0716-4d55-4d4d-8e1a-06982a79c321 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:24.954756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d0716-4d55-4d4d-8e1a-06982a79c321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:25.024734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0d4d0716-4d55-4d4d-8e1a-06982a79c321 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:25.025996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0d4d0716-4d55-4d4d-8e1a-06982a79c321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:25.056627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:25.126139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:25.406815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c12ce7-4b6a-4566-ba12-30bc0d65f0c3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:25.408791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90c12ce7-4b6a-4566-ba12-30bc0d65f0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:25.515479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c12ce7-4b6a-4566-ba12-30bc0d65f0c3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:25.544238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:25.595133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d130dc-78f7-4e1e-aef1-eeea27f3ae0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:25.595747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d130dc-78f7-4e1e-aef1-eeea27f3ae0e service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:25.596029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d130dc-78f7-4e1e-aef1-eeea27f3ae0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:25.596296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d130dc-78f7-4e1e-aef1-eeea27f3ae0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:25.597925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a7d130dc-78f7-4e1e-aef1-eeea27f3ae0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:25.711275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d130dc-78f7-4e1e-aef1-eeea27f3ae0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:25.712636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d130dc-78f7-4e1e-aef1-eeea27f3ae0e service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:25.856129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 730/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:28.062971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e106-5451-4af0-9e42-677aea6df7b6 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:28.063586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e106-5451-4af0-9e42-677aea6df7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:28.063586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0e106-5451-4af0-9e42-677aea6df7b6 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:28.065273 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:28.074420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2f74-1cbf-4721-bb8f-53c0d0de0450 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:28.074860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2f74-1cbf-4721-bb8f-53c0d0de0450 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:28.074969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab2f74-1cbf-4721-bb8f-53c0d0de0450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:28.143500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d3ab2f74-1cbf-4721-bb8f-53c0d0de0450 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:28.144708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d3ab2f74-1cbf-4721-bb8f-53c0d0de0450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:28.152944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:28.242741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:28.524621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0e106-5451-4af0-9e42-677aea6df7b6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:28.526842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bde0e106-5451-4af0-9e42-677aea6df7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:28.634855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0e106-5451-4af0-9e42-677aea6df7b6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:28.692809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:28.714925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e256f513-4ba6-4125-a75a-04e13384e834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:28.715868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256f513-4ba6-4125-a75a-04e13384e834 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:28.716183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256f513-4ba6-4125-a75a-04e13384e834 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:28.716626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e256f513-4ba6-4125-a75a-04e13384e834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:28.718389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e256f513-4ba6-4125-a75a-04e13384e834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:28.847768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256f513-4ba6-4125-a75a-04e13384e834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:28.849132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e256f513-4ba6-4125-a75a-04e13384e834 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:28.868460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 730/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:31.071124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c2e7-2082-490c-9818-81ff66955c81 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:31.071722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c2e7-2082-490c-9818-81ff66955c81 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:31.071722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9549c2e7-2082-490c-9818-81ff66955c81 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:31.073607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:31.081777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a8375-4bf9-4df2-9c8f-d98d197c37c2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:31.082320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a8375-4bf9-4df2-9c8f-d98d197c37c2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:31.082320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a8375-4bf9-4df2-9c8f-d98d197c37c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:31.186166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-517a8375-4bf9-4df2-9c8f-d98d197c37c2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:31.187393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-517a8375-4bf9-4df2-9c8f-d98d197c37c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:31.240612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:31.310143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:31.596861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c2e7-2082-490c-9818-81ff66955c81 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:31.599463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9549c2e7-2082-490c-9818-81ff66955c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:31.719847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9549c2e7-2082-490c-9818-81ff66955c81 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:31.763222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:31.799692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4fd57-9a98-47ad-b385-cc2f23627ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:31.800324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4fd57-9a98-47ad-b385-cc2f23627ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:31.800594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4fd57-9a98-47ad-b385-cc2f23627ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:31.800854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4fd57-9a98-47ad-b385-cc2f23627ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:31.802467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-24a4fd57-9a98-47ad-b385-cc2f23627ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:31.915166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4fd57-9a98-47ad-b385-cc2f23627ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:31.916607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4fd57-9a98-47ad-b385-cc2f23627ed7 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:31.935053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 733/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:34.086083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5740ab-ad6d-4872-94f6-219785665766 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:34.086711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5740ab-ad6d-4872-94f6-219785665766 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:34.086711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5740ab-ad6d-4872-94f6-219785665766 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:34.087969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:34.094471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10131af-6619-4c43-8bcc-f1a93cf468e2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:34.095208 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10131af-6619-4c43-8bcc-f1a93cf468e2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:34.095344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10131af-6619-4c43-8bcc-f1a93cf468e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:34.169011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a10131af-6619-4c43-8bcc-f1a93cf468e2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:34.170267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a10131af-6619-4c43-8bcc-f1a93cf468e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:34.188576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:34.271947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:34.566058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5740ab-ad6d-4872-94f6-219785665766 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:34.568585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0e5740ab-ad6d-4872-94f6-219785665766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:34.700958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5740ab-ad6d-4872-94f6-219785665766 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:34.772270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:34.779483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b64c2a-d3b4-4008-9cfa-92906abf8f25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:34.780092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b64c2a-d3b4-4008-9cfa-92906abf8f25 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:34.780359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b64c2a-d3b4-4008-9cfa-92906abf8f25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:34.780624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b64c2a-d3b4-4008-9cfa-92906abf8f25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:34.782210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-93b64c2a-d3b4-4008-9cfa-92906abf8f25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:34.894881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b64c2a-d3b4-4008-9cfa-92906abf8f25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:34.896338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b64c2a-d3b4-4008-9cfa-92906abf8f25 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:34.914523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 733/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:37.069953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f140-bacf-4d2e-b556-7e5fbfa03484 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:37.070823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f140-bacf-4d2e-b556-7e5fbfa03484 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:37.070823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f140-bacf-4d2e-b556-7e5fbfa03484 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:37.072979 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:31:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:37.081667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f316-440d-4fc3-aa59-e1bfb0492f6e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:37.082136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f316-440d-4fc3-aa59-e1bfb0492f6e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:37.082251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b0f316-440d-4fc3-aa59-e1bfb0492f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:37.152468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c1b0f316-440d-4fc3-aa59-e1bfb0492f6e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:37.153715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c1b0f316-440d-4fc3-aa59-e1bfb0492f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:37.204887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:37.265540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:37.545322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95f140-bacf-4d2e-b556-7e5fbfa03484 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:37.547869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9b95f140-bacf-4d2e-b556-7e5fbfa03484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:37.662026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95f140-bacf-4d2e-b556-7e5fbfa03484 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:37.712506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:37.739543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc740b49-f69c-4c14-9486-158f841974ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:37.740146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740b49-f69c-4c14-9486-158f841974ab service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:37.740417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740b49-f69c-4c14-9486-158f841974ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:37.740683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc740b49-f69c-4c14-9486-158f841974ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:37.742306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fc740b49-f69c-4c14-9486-158f841974ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:37.854346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc740b49-f69c-4c14-9486-158f841974ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:37.855778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc740b49-f69c-4c14-9486-158f841974ab service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:37.874413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 736/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:31:47.264036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=22 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:47.871881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=66 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:58.368663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0467ea-e8c2-4518-8d1b-0c3dad2c714b None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:58.369546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0467ea-e8c2-4518-8d1b-0c3dad2c714b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:58.370099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0467ea-e8c2-4518-8d1b-0c3dad2c714b None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:58.372226 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 735/1471] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:31:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:58.379089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf08b-ce73-4691-982d-e04d52d594a9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:58.379610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf08b-ce73-4691-982d-e04d52d594a9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:58.379715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdf08b-ce73-4691-982d-e04d52d594a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:58.446946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5fbdf08b-ce73-4691-982d-e04d52d594a9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:58.448173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5fbdf08b-ce73-4691-982d-e04d52d594a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:58.548327 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 737/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:58.855984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9008-0976-4c28-a14b-c3444cf125d2 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:58.856231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9008-0976-4c28-a14b-c3444cf125d2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:58.856646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9008-0976-4c28-a14b-c3444cf125d2 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:58.858061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 736/1473] 10.222.0.48 () {54 vars in 962 bytes} [Sat Sep 17 03:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:31:58.863561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f6117-f3cc-4684-975b-194a6aea29ef None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:58.864010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f6117-f3cc-4684-975b-194a6aea29ef None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:58.864290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f6117-f3cc-4684-975b-194a6aea29ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:58.944511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4b4f6117-f3cc-4684-975b-194a6aea29ef None None] MFA Rules not processed for user `c46c91e383f44555b753b6500c9cdc44`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:31:58.945746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4b4f6117-f3cc-4684-975b-194a6aea29ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:58.970172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:59.041811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 738/1474] 10.222.0.48 () {58 vars in 1059 bytes} [Sat Sep 17 03:31:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:31:59.050541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db9008-0976-4c28-a14b-c3444cf125d2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:31:59.053076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-79db9008-0976-4c28-a14b-c3444cf125d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:59.162160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db9008-0976-4c28-a14b-c3444cf125d2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:31:59.248164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e80d7-2260-48a9-9401-3e11483ef78e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46c91e383f44555b753b6500c9cdc44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:31:59.248773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e80d7-2260-48a9-9401-3e11483ef78e service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:31:59.249054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e80d7-2260-48a9-9401-3e11483ef78e service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:31:59.249324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e80d7-2260-48a9-9401-3e11483ef78e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:31:59.250957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-218e80d7-2260-48a9-9401-3e11483ef78e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:31:59.311250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:31:59.390587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e80d7-2260-48a9-9401-3e11483ef78e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:31:59.392044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e80d7-2260-48a9-9401-3e11483ef78e service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:31:59.411737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 737/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:31:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:32:01.658426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042b71-fa61-4c10-97db-1acb3763a42f None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:01.659330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042b71-fa61-4c10-97db-1acb3763a42f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:01.659330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71042b71-fa61-4c10-97db-1acb3763a42f None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:01.661523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 739/1476] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:32:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:32:01.667375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04c7fb-eca9-4e12-a830-b50ed8e2b515 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:01.667843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04c7fb-eca9-4e12-a830-b50ed8e2b515 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:01.667942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e04c7fb-eca9-4e12-a830-b50ed8e2b515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:01.741323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5e04c7fb-eca9-4e12-a830-b50ed8e2b515 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:32:01.742794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5e04c7fb-eca9-4e12-a830-b50ed8e2b515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:01.847850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 738/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:32:02.119181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71042b71-fa61-4c10-97db-1acb3763a42f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:32:02.121692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-71042b71-fa61-4c10-97db-1acb3763a42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:02.267003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71042b71-fa61-4c10-97db-1acb3763a42f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:32:02.322064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:02.375072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff7d1a-8e80-4ff8-b7d4-5602a9aa7083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:32:02.375840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff7d1a-8e80-4ff8-b7d4-5602a9aa7083 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:02.376097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff7d1a-8e80-4ff8-b7d4-5602a9aa7083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:02.376433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff7d1a-8e80-4ff8-b7d4-5602a9aa7083 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:02.377722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff7d1a-8e80-4ff8-b7d4-5602a9aa7083 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:32:02.380202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-e3ff7d1a-8e80-4ff8-b7d4-5602a9aa7083 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:32:02.380202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: warnings.warn(msg) Sep 17 03:32:02.380202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: Sep 17 03:32:02.381740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff7d1a-8e80-4ff8-b7d4-5602a9aa7083 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:32:02.401467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 740/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Sat Sep 17 03:32:02 2022] GET /identity/v3/projects => generated 2553 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:32:04.542329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79f612-fdf8-4da0-92f8-fdeddac119fa None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:04.543264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79f612-fdf8-4da0-92f8-fdeddac119fa None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:04.543264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79f612-fdf8-4da0-92f8-fdeddac119fa None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:04.545374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 739/1479] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:32:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:32:04.553562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812fca7-e641-4bc9-949f-e0d66f9ac5d7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:04.554064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812fca7-e641-4bc9-949f-e0d66f9ac5d7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:04.554172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812fca7-e641-4bc9-949f-e0d66f9ac5d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:04.626232 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8812fca7-e641-4bc9-949f-e0d66f9ac5d7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:32:04.627831 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8812fca7-e641-4bc9-949f-e0d66f9ac5d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:04.724547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 741/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:32:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:32:05.016729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79f612-fdf8-4da0-92f8-fdeddac119fa None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:32:05.018342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2a79f612-fdf8-4da0-92f8-fdeddac119fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:05.028630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:05.170320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79f612-fdf8-4da0-92f8-fdeddac119fa None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:32:05.254245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:05.288246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c847974-198e-4886-8ede-e688c7f9437d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:32:05.288864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847974-198e-4886-8ede-e688c7f9437d service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:05.289144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847974-198e-4886-8ede-e688c7f9437d service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:05.289420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c847974-198e-4886-8ede-e688c7f9437d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:05.291095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9c847974-198e-4886-8ede-e688c7f9437d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:05.384913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c847974-198e-4886-8ede-e688c7f9437d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:32:05.386559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c847974-198e-4886-8ede-e688c7f9437d service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:32:05.404740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 740/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:32:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:32:07.719424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3d34-9d07-4009-8d56-9d6b879b9ae5 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:07.719967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3d34-9d07-4009-8d56-9d6b879b9ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:07.719967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3d34-9d07-4009-8d56-9d6b879b9ae5 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:07.722035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 742/1482] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:32:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:32:07.730224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696074-1aa3-4d86-9ff4-62b4e714af6b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:07.730750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696074-1aa3-4d86-9ff4-62b4e714af6b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:07.730750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696074-1aa3-4d86-9ff4-62b4e714af6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:07.797776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-10696074-1aa3-4d86-9ff4-62b4e714af6b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:32:07.798992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-10696074-1aa3-4d86-9ff4-62b4e714af6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:07.846992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:07.898913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 741/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:32:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:32:08.186339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3d34-9d07-4009-8d56-9d6b879b9ae5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:32:08.188710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a14f3d34-9d07-4009-8d56-9d6b879b9ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:08.221840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:08.303746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3d34-9d07-4009-8d56-9d6b879b9ae5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:32:08.383533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c31efc-554f-4523-9f5d-d6e36f2c4a79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:32:08.384194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c31efc-554f-4523-9f5d-d6e36f2c4a79 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:08.384428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c31efc-554f-4523-9f5d-d6e36f2c4a79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:08.384772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c31efc-554f-4523-9f5d-d6e36f2c4a79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:08.387329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-46c31efc-554f-4523-9f5d-d6e36f2c4a79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:08.472468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:08.512571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c31efc-554f-4523-9f5d-d6e36f2c4a79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:32:08.514027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c31efc-554f-4523-9f5d-d6e36f2c4a79 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:32:08.532252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 743/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:32:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:32:10.703760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd121b-025e-49bd-b601-d130d6715a3a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:10.704297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd121b-025e-49bd-b601-d130d6715a3a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:10.704297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd121b-025e-49bd-b601-d130d6715a3a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:10.705565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 742/1485] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:32:10.711197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc986a-899f-4c12-ae7a-9266bf3950ea None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:10.711650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc986a-899f-4c12-ae7a-9266bf3950ea None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:10.711957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc986a-899f-4c12-ae7a-9266bf3950ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:10.783336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fffc986a-899f-4c12-ae7a-9266bf3950ea None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:32:10.784595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fffc986a-899f-4c12-ae7a-9266bf3950ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:10.889815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 744/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:32:11.169813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd121b-025e-49bd-b601-d130d6715a3a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:32:11.171237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-43fd121b-025e-49bd-b601-d130d6715a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:11.276739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd121b-025e-49bd-b601-d130d6715a3a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:32:11.348154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:11.349645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef1ae4-455c-48bd-a3c3-d682b941a832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:32:11.350493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1ae4-455c-48bd-a3c3-d682b941a832 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:11.350773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1ae4-455c-48bd-a3c3-d682b941a832 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:11.351060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef1ae4-455c-48bd-a3c3-d682b941a832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:11.353285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b5ef1ae4-455c-48bd-a3c3-d682b941a832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:11.468006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1ae4-455c-48bd-a3c3-d682b941a832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:32:11.469466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef1ae4-455c-48bd-a3c3-d682b941a832 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:32:11.487813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 743/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:32:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:32:13.801097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e330c3-79a1-418f-a895-1bc335a53c1e None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:13.801627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e330c3-79a1-418f-a895-1bc335a53c1e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:13.801627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e330c3-79a1-418f-a895-1bc335a53c1e None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:13.802941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 745/1488] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:32:13.808692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dcc42-7888-48fa-acc8-56dc94146bbb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:13.809165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dcc42-7888-48fa-acc8-56dc94146bbb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:13.809282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454dcc42-7888-48fa-acc8-56dc94146bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:13.881671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-454dcc42-7888-48fa-acc8-56dc94146bbb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:32:13.883113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-454dcc42-7888-48fa-acc8-56dc94146bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:13.937478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:13.985222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 744/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:32:14.270316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e330c3-79a1-418f-a895-1bc335a53c1e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:32:14.271896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f7e330c3-79a1-418f-a895-1bc335a53c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:14.310363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:14.379727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e330c3-79a1-418f-a895-1bc335a53c1e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:32:14.456020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d14870-2305-4e06-8f81-6a98eb4dc9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:32:14.456630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d14870-2305-4e06-8f81-6a98eb4dc9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:14.456904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d14870-2305-4e06-8f81-6a98eb4dc9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:14.457245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d14870-2305-4e06-8f81-6a98eb4dc9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:14.458790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b0d14870-2305-4e06-8f81-6a98eb4dc9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:14.546611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:14.579107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d14870-2305-4e06-8f81-6a98eb4dc9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:32:14.580609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d14870-2305-4e06-8f81-6a98eb4dc9b5 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:32:14.599381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 746/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:32:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:32:17.078032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b86c6-29dd-405d-99ab-b74a391887c7 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:17.078595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b86c6-29dd-405d-99ab-b74a391887c7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:17.078595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b86c6-29dd-405d-99ab-b74a391887c7 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:17.079935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 745/1491] 10.222.0.48 () {54 vars in 927 bytes} [Sat Sep 17 03:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:32:17.085411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581eb2c-9ade-4a55-8cb8-f60aa7ef2f12 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:17.085885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581eb2c-9ade-4a55-8cb8-f60aa7ef2f12 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:17.085987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581eb2c-9ade-4a55-8cb8-f60aa7ef2f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:17.151299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4581eb2c-9ade-4a55-8cb8-f60aa7ef2f12 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:32:17.152521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4581eb2c-9ade-4a55-8cb8-f60aa7ef2f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:17.254168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 747/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Sat Sep 17 03:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:32:17.538482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b86c6-29dd-405d-99ab-b74a391887c7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:32:17.540024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-069b86c6-29dd-405d-99ab-b74a391887c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:17.646195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b86c6-29dd-405d-99ab-b74a391887c7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:32:17.718293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e850af-4498-4c4d-a9f0-5113fbca4221 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:32:17.718902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e850af-4498-4c4d-a9f0-5113fbca4221 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:32:17.719173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e850af-4498-4c4d-a9f0-5113fbca4221 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:32:17.719437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e850af-4498-4c4d-a9f0-5113fbca4221 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:32:17.721014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-49e850af-4498-4c4d-a9f0-5113fbca4221 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:32:17.730054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:17.839847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e850af-4498-4c4d-a9f0-5113fbca4221 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:32:17.841255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e850af-4498-4c4d-a9f0-5113fbca4221 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:32:17.859178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 746/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:32:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:32:27.248450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=82 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:32:27.856688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=50 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:31.286373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229acc-3ffe-4a0f-97e5-6fee8c8b3618 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:31.286964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229acc-3ffe-4a0f-97e5-6fee8c8b3618 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:31.286964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe229acc-3ffe-4a0f-97e5-6fee8c8b3618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:31.366891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fe229acc-3ffe-4a0f-97e5-6fee8c8b3618 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:33:31.368114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe229acc-3ffe-4a0f-97e5-6fee8c8b3618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:31.469010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 748/1494] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:33:31.478375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f847-a5f6-4105-a6b8-193a11686006 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:31.478931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f847-a5f6-4105-a6b8-193a11686006 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:31.479056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f847-a5f6-4105-a6b8-193a11686006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:31.562095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-24e5f847-a5f6-4105-a6b8-193a11686006 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:33:31.563240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-24e5f847-a5f6-4105-a6b8-193a11686006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:31.674758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 747/1495] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:33:31.681366 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229acc-3ffe-4a0f-97e5-6fee8c8b3618 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:31.682608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fe229acc-3ffe-4a0f-97e5-6fee8c8b3618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:31.694170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe229acc-3ffe-4a0f-97e5-6fee8c8b3618 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:31.763244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:31.802299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:31.802895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:31.803196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:31.803483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:31.804134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:33:31.804437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:31.805486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:33:31.805486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: warnings.warn(msg) Sep 17 03:33:31.805486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: Sep 17 03:33:31.806415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:31.818113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 749/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:33:31.826570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5f847-a5f6-4105-a6b8-193a11686006 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:31.836381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5f847-a5f6-4105-a6b8-193a11686006 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:31.902320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:31.937250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:31.937900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:31.938174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:31.938443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:31.939069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:31.940825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:33:31.940825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: warnings.warn(msg) Sep 17 03:33:31.940825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: Sep 17 03:33:31.942052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:32.002258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 748/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:33:31 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:33:32.006786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:32.008357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:32.043814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e9b7a-65ed-4421-8d68-9ed4226c84f0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:32.145619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:32.146242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:32.146520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:32.146786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:32.147413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:32.148427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:33:32.148427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: warnings.warn(msg) Sep 17 03:33:32.148427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: Sep 17 03:33:32.149634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:32.194696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 750/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:33:32 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:33:32.199033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:32.200555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:32.265900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e8b813-7fe4-4ad9-8241-8d2c2a144f3d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:32.350813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:32.362620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:32.363227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:32.363502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:32.363769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:32.364405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:32.365430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:33:32.365430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: warnings.warn(msg) Sep 17 03:33:32.365430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: Sep 17 03:33:32.366383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:32.378983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 749/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:33:32.383401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:32.385285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:32.397103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf115f-c8ea-446c-845f-e89362414cbf admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:32.423905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:32.507546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343883ac-ac04-42e0-9abd-a1c1d4496909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:32.508376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343883ac-ac04-42e0-9abd-a1c1d4496909 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:32.509098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343883ac-ac04-42e0-9abd-a1c1d4496909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:32.509486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343883ac-ac04-42e0-9abd-a1c1d4496909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:32.510468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343883ac-ac04-42e0-9abd-a1c1d4496909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:32.511554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-343883ac-ac04-42e0-9abd-a1c1d4496909 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:33:32.511554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: warnings.warn(msg) Sep 17 03:33:32.511554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: Sep 17 03:33:32.512445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343883ac-ac04-42e0-9abd-a1c1d4496909 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:32.528557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 751/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:33:32.535400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:32.537612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:32.579660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2973e8-c552-4cae-8817-63931aaaf6e5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:32.682044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350430ea-efd3-4958-91f6-a5fe7d12f8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:32.682623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350430ea-efd3-4958-91f6-a5fe7d12f8ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:32.682897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350430ea-efd3-4958-91f6-a5fe7d12f8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:32.683161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350430ea-efd3-4958-91f6-a5fe7d12f8ae admin admin] PATH_INFO: `/v3/projects/16d47b3f8add40689bce08329a877d11/users/889924e2a4454ab3861ed5e606416408/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:32.706057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350430ea-efd3-4958-91f6-a5fe7d12f8ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=16d47b3f8add40689bce08329a877d11, user_id=889924e2a4454ab3861ed5e606416408, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:32.707089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-350430ea-efd3-4958-91f6-a5fe7d12f8ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:33:32.707089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: warnings.warn(msg) Sep 17 03:33:32.707089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: Sep 17 03:33:32.709032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350430ea-efd3-4958-91f6-a5fe7d12f8ae admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:32.735101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 750/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:33:32 2022] PUT /identity/v3/projects/16d47b3f8add40689bce08329a877d11/users/889924e2a4454ab3861ed5e606416408/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:33:32.748987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2a52b-8d43-4e74-a74b-ee10887a8e93 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:32.749345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2a52b-8d43-4e74-a74b-ee10887a8e93 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:32.749721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2a52b-8d43-4e74-a74b-ee10887a8e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:32.815050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1ba2a52b-8d43-4e74-a74b-ee10887a8e93 None None] MFA Rules not processed for user `889924e2a4454ab3861ed5e606416408`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:33:32.816245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1ba2a52b-8d43-4e74-a74b-ee10887a8e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:32.910748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 752/1502] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:33:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:33:32.931172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec645d-f4e8-4520-aeb9-8acc8be0892e None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:32.931455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec645d-f4e8-4520-aeb9-8acc8be0892e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:32.931734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec645d-f4e8-4520-aeb9-8acc8be0892e None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:32.933116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 751/1503] 10.222.0.48 () {54 vars in 964 bytes} [Sat Sep 17 03:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:33:32.939512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb70a-e209-4a36-a4ca-ee13cdd3ba91 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:32.939825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb70a-e209-4a36-a4ca-ee13cdd3ba91 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:32.940099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dceb70a-e209-4a36-a4ca-ee13cdd3ba91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:32.972236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:33.018767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1dceb70a-e209-4a36-a4ca-ee13cdd3ba91 None None] MFA Rules not processed for user `0cd4b1beb0b149ceba9940a0631f23b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:33:33.019989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1dceb70a-e209-4a36-a4ca-ee13cdd3ba91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:33.101587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 753/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Sat Sep 17 03:33:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:33:33.110815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec645d-f4e8-4520-aeb9-8acc8be0892e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:33.114100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e2ec645d-f4e8-4520-aeb9-8acc8be0892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:33.182928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:33.244425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec645d-f4e8-4520-aeb9-8acc8be0892e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:33.323886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:33.324525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:33.324801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:33.325067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:33.326673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:33.432641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:33.434164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:33.437649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:33.454124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 752/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:33:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:33:33.503622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8fae0-d23f-4b2d-9592-17b4c68192cf None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:33.504288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8fae0-d23f-4b2d-9592-17b4c68192cf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:33.504731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8fae0-d23f-4b2d-9592-17b4c68192cf None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:33.507047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 754/1506] 10.222.0.48 () {52 vars in 830 bytes} [Sat Sep 17 03:33:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:33:33.513710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:33.515579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:33.627847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282d01c-19cd-43cb-85b4-b173ecbf12b7 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:33.723028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:33.723654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:33.723922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:33.724180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] PATH_INFO: `/v3/users/889924e2a4454ab3861ed5e606416408` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:33.737613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] RBAC: Authorizing `identity:delete_user(user_id=889924e2a4454ab3861ed5e606416408)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:33.738869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:33:33.738869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: warnings.warn(msg) Sep 17 03:33:33.738869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: Sep 17 03:33:33.740276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:33.750793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:33.811260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889924e2a4454ab3861ed5e606416408'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:33.811866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889924e2a4454ab3861ed5e606416408'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:33.823649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889924e2a4454ab3861ed5e606416408'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:33.838249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889924e2a4454ab3861ed5e606416408'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:33.838721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889924e2a4454ab3861ed5e606416408'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:33.868993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 753/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:33:33 2022] DELETE /identity/v3/users/889924e2a4454ab3861ed5e606416408 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:33:33.873838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356589-c390-44eb-9fea-82b702258dda None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:33.874119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356589-c390-44eb-9fea-82b702258dda None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:33.874503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38356589-c390-44eb-9fea-82b702258dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:33.935085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-38356589-c390-44eb-9fea-82b702258dda None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:33:33.936307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-38356589-c390-44eb-9fea-82b702258dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:34.016378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:34.029349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 755/1508] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:33:34.039994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:34.041306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:34.149411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b663a85-ea29-43f1-b22f-ea16c22ef645 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:34.206660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:34.226688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2f11a-185e-4a9c-b10a-519eafe0be96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:34.227327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2f11a-185e-4a9c-b10a-519eafe0be96 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:34.227597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2f11a-185e-4a9c-b10a-519eafe0be96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:34.227857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2f11a-185e-4a9c-b10a-519eafe0be96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:34.229432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-50d2f11a-185e-4a9c-b10a-519eafe0be96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:34.347531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2f11a-185e-4a9c-b10a-519eafe0be96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:34.348910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2f11a-185e-4a9c-b10a-519eafe0be96 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:34.368335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 754/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:33:34.710190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356589-c390-44eb-9fea-82b702258dda None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:33:34.711526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-38356589-c390-44eb-9fea-82b702258dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:33:34.724030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38356589-c390-44eb-9fea-82b702258dda None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:33:34.825013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:33:34.825657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:33:34.825973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:33:34.826248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] PATH_INFO: `/v3/projects/16d47b3f8add40689bce08329a877d11` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:33:34.837287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16d47b3f8add40689bce08329a877d11)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:33:34.838395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:33:34.838395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: warnings.warn(msg) Sep 17 03:33:34.838395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: Sep 17 03:33:34.839613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:33:34.906143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16d47b3f8add40689bce08329a877d11', 'request_id': 'req-2a0ead07-28d6-468a-b89d-0e72d358d978'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:34.922533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16d47b3f8add40689bce08329a877d11', 'request_id': 'req-2a0ead07-28d6-468a-b89d-0e72d358d978'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:34.935899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16d47b3f8add40689bce08329a877d11', 'request_id': 'req-2a0ead07-28d6-468a-b89d-0e72d358d978'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:34.961420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] The token cache is being invalidate because project 16d47b3f8add40689bce08329a877d11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:33:34.961706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:34.962257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a0ead07-28d6-468a-b89d-0e72d358d978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:33:34.963634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 756/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:33:34 2022] DELETE /identity/v3/projects/16d47b3f8add40689bce08329a877d11 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:33:44.366056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=62 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:33:44.959335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:35:08.159711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8cfa-7fed-4cab-830b-b4f1d75174ee None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:08.160387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8cfa-7fed-4cab-830b-b4f1d75174ee None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:08.160387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b8cfa-7fed-4cab-830b-b4f1d75174ee None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:08.161792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:08.167099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f22f7-1e20-499a-8a4f-166bd4a8a35d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:08.167556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f22f7-1e20-499a-8a4f-166bd4a8a35d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:08.167657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f22f7-1e20-499a-8a4f-166bd4a8a35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:08.262267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f15f22f7-1e20-499a-8a4f-166bd4a8a35d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:08.263382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f15f22f7-1e20-499a-8a4f-166bd4a8a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:08.380946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:35:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:08.537990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b8cfa-7fed-4cab-830b-b4f1d75174ee None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:08.541983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e62b8cfa-7fed-4cab-830b-b4f1d75174ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:08.673670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b8cfa-7fed-4cab-830b-b4f1d75174ee None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:08.680013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1bf9b9-db2a-4b02-b65d-42c1186770cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:08.680619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf9b9-db2a-4b02-b65d-42c1186770cf service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:08.680901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf9b9-db2a-4b02-b65d-42c1186770cf service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:08.681203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1bf9b9-db2a-4b02-b65d-42c1186770cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:08.689686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf9b9-db2a-4b02-b65d-42c1186770cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:08.691308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1bf9b9-db2a-4b02-b65d-42c1186770cf service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:08.700906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 756/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:35:09.803172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a268bc-fe5a-43e6-940b-4370ddd11852 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:09.803763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a268bc-fe5a-43e6-940b-4370ddd11852 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:09.803763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a268bc-fe5a-43e6-940b-4370ddd11852 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:09.804976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:35:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:09.815396 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfe92-df9c-4c2b-9a01-b90daba4af3f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:09.815921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfe92-df9c-4c2b-9a01-b90daba4af3f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:09.815921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debfe92-df9c-4c2b-9a01-b90daba4af3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:09.837195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4debfe92-df9c-4c2b-9a01-b90daba4af3f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:09.838460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4debfe92-df9c-4c2b-9a01-b90daba4af3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:09.848511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:09.998902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a268bc-fe5a-43e6-940b-4370ddd11852 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:10.022701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a268bc-fe5a-43e6-940b-4370ddd11852 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:10.029474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602632cf-e248-4f18-a98d-be68d3eebb5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:10.030102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602632cf-e248-4f18-a98d-be68d3eebb5c service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:10.030373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602632cf-e248-4f18-a98d-be68d3eebb5c service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:10.030631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602632cf-e248-4f18-a98d-be68d3eebb5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:10.039325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602632cf-e248-4f18-a98d-be68d3eebb5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:10.041483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602632cf-e248-4f18-a98d-be68d3eebb5c service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:10.051180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 759/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:35:10.101665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347b07-35d3-425e-9a61-76a5e0872b44 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:10.101964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347b07-35d3-425e-9a61-76a5e0872b44 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:10.102255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28347b07-35d3-425e-9a61-76a5e0872b44 None None] PATH_INFO: `/v3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:10.103828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 758/1517] 10.222.0.55 () {54 vars in 925 bytes} [Sat Sep 17 03:35:10 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:35:10.111686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085713b-4164-48bb-8d9b-70a0e207e263 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:10.111956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085713b-4164-48bb-8d9b-70a0e207e263 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:10.112227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085713b-4164-48bb-8d9b-70a0e207e263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:10.186591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3085713b-4164-48bb-8d9b-70a0e207e263 None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:10.187803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3085713b-4164-48bb-8d9b-70a0e207e263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:10.212939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:35:10.272805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 760/1518] 10.222.0.55 () {58 vars in 1015 bytes} [Sat Sep 17 03:35:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:19.140222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d151-e563-4861-aef5-077284391232 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:19.140705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d151-e563-4861-aef5-077284391232 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:19.140705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1d151-e563-4861-aef5-077284391232 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:19.142350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 759/1519] 10.222.0.48 () {54 vars in 961 bytes} [Sat Sep 17 03:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:19.147555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ea6d2-037f-48f9-8f4b-895034dc5aa7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:19.147994 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ea6d2-037f-48f9-8f4b-895034dc5aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:19.148098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ea6d2-037f-48f9-8f4b-895034dc5aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:19.168076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3b5ea6d2-037f-48f9-8f4b-895034dc5aa7 None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:19.169265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b5ea6d2-037f-48f9-8f4b-895034dc5aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:19.178429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 761/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Sat Sep 17 03:35:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:35:19.185926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1d151-e563-4861-aef5-077284391232 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:19.199729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1d151-e563-4861-aef5-077284391232 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:19.205057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c091d6-8bf2-4bac-b588-2a9e4d1bbd72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:19.205638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c091d6-8bf2-4bac-b588-2a9e4d1bbd72 service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:19.205955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c091d6-8bf2-4bac-b588-2a9e4d1bbd72 service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:19.206220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c091d6-8bf2-4bac-b588-2a9e4d1bbd72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:19.214651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c091d6-8bf2-4bac-b588-2a9e4d1bbd72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:19.216228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c091d6-8bf2-4bac-b588-2a9e4d1bbd72 service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:19.225655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 760/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:35:21.555672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da05aa-c40c-40e3-9128-802819399186 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:21.556615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da05aa-c40c-40e3-9128-802819399186 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:21.556615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da05aa-c40c-40e3-9128-802819399186 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:21.558898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:35:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:21.566180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555315cb-9929-45e0-a684-e78222063838 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:21.566669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555315cb-9929-45e0-a684-e78222063838 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:21.566669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555315cb-9929-45e0-a684-e78222063838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:21.595866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-555315cb-9929-45e0-a684-e78222063838 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:21.597078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-555315cb-9929-45e0-a684-e78222063838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:21.606278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:21.776789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da05aa-c40c-40e3-9128-802819399186 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:21.792949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da05aa-c40c-40e3-9128-802819399186 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:21.799471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931cadcc-0f5e-41e2-bcc9-f89d49914d60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:21.800077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cadcc-0f5e-41e2-bcc9-f89d49914d60 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:21.800359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cadcc-0f5e-41e2-bcc9-f89d49914d60 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:21.800630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931cadcc-0f5e-41e2-bcc9-f89d49914d60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:21.809314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cadcc-0f5e-41e2-bcc9-f89d49914d60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:21.810887 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931cadcc-0f5e-41e2-bcc9-f89d49914d60 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:21.820423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 763/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:35:22.873730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fce9-8c43-4d6b-99f3-333f785108a8 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:22.874372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fce9-8c43-4d6b-99f3-333f785108a8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:22.874372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fce9-8c43-4d6b-99f3-333f785108a8 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:22.875705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 03:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:22.883018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809befb-9a1b-4055-a9d3-7da82024cb2c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:22.883860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809befb-9a1b-4055-a9d3-7da82024cb2c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:22.883976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809befb-9a1b-4055-a9d3-7da82024cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:22.907320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b809befb-9a1b-4055-a9d3-7da82024cb2c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:22.908557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b809befb-9a1b-4055-a9d3-7da82024cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:22.917468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 03:35:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:23.071781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fce9-8c43-4d6b-99f3-333f785108a8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:23.096200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fce9-8c43-4d6b-99f3-333f785108a8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:23.102421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916932ee-48b9-4756-8608-31f8d545421c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:23.103031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916932ee-48b9-4756-8608-31f8d545421c service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:23.103305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916932ee-48b9-4756-8608-31f8d545421c service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:23.103569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916932ee-48b9-4756-8608-31f8d545421c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:23.113035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916932ee-48b9-4756-8608-31f8d545421c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:23.114666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916932ee-48b9-4756-8608-31f8d545421c service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:23.124681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 763/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:35:27.134578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bacc0-773f-49c9-8f66-a804b6326a9a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:27.135549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bacc0-773f-49c9-8f66-a804b6326a9a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:27.135549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bacc0-773f-49c9-8f66-a804b6326a9a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:27.137552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:35:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:27.145032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22da2-d495-498d-a0ee-1cdb69dd7d1c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:27.145489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22da2-d495-498d-a0ee-1cdb69dd7d1c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:27.145594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed22da2-d495-498d-a0ee-1cdb69dd7d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:27.166096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fed22da2-d495-498d-a0ee-1cdb69dd7d1c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:27.167296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fed22da2-d495-498d-a0ee-1cdb69dd7d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:27.176660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:35:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:27.465915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bacc0-773f-49c9-8f66-a804b6326a9a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:27.468037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-de2bacc0-773f-49c9-8f66-a804b6326a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:27.552558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bacc0-773f-49c9-8f66-a804b6326a9a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:27.557040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81545d2-eacc-4ea2-be3c-3915ab7dae6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:27.557640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81545d2-eacc-4ea2-be3c-3915ab7dae6f service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:27.557946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81545d2-eacc-4ea2-be3c-3915ab7dae6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:27.558214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81545d2-eacc-4ea2-be3c-3915ab7dae6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:27.568000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81545d2-eacc-4ea2-be3c-3915ab7dae6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:27.569457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81545d2-eacc-4ea2-be3c-3915ab7dae6f service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:27.579285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 766/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:35:29.687834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378580-1491-4be2-b8b2-d78438c609a1 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:29.688793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378580-1491-4be2-b8b2-d78438c609a1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:29.688793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2378580-1491-4be2-b8b2-d78438c609a1 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:29.690830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:29.696403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c19c25-1444-490f-a893-b23db3506993 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:29.696855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c19c25-1444-490f-a893-b23db3506993 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:29.696962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c19c25-1444-490f-a893-b23db3506993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:29.717505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-70c19c25-1444-490f-a893-b23db3506993 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:29.718749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-70c19c25-1444-490f-a893-b23db3506993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:29.727140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:30.019830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2378580-1491-4be2-b8b2-d78438c609a1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:30.036458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2378580-1491-4be2-b8b2-d78438c609a1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:30.040569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885efb2-e354-44d3-99b1-5d37db3c0fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:30.041168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885efb2-e354-44d3-99b1-5d37db3c0fcd service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:30.041464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885efb2-e354-44d3-99b1-5d37db3c0fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:30.041785 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885efb2-e354-44d3-99b1-5d37db3c0fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:30.050954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885efb2-e354-44d3-99b1-5d37db3c0fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:30.052405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885efb2-e354-44d3-99b1-5d37db3c0fcd service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:30.061525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 766/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:35:33.675555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f0f9-99b8-45d8-85ca-7c2f5c67a0f2 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:33.676409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f0f9-99b8-45d8-85ca-7c2f5c67a0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:33.676409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f0f9-99b8-45d8-85ca-7c2f5c67a0f2 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:33.678525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:35:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:33.684974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3c27f-98c2-403b-a010-3a7fd1d1cfd3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:33.685450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3c27f-98c2-403b-a010-3a7fd1d1cfd3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:33.685558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3c27f-98c2-403b-a010-3a7fd1d1cfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:33.706976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f4f3c27f-98c2-403b-a010-3a7fd1d1cfd3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:33.708182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f4f3c27f-98c2-403b-a010-3a7fd1d1cfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:33.716537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:34.012963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f0f9-99b8-45d8-85ca-7c2f5c67a0f2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:34.015316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5820f0f9-99b8-45d8-85ca-7c2f5c67a0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:34.095982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:35:34.110304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f0f9-99b8-45d8-85ca-7c2f5c67a0f2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:34.114317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f758-9841-47c1-bb0f-0abc2367c49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:34.114925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f758-9841-47c1-bb0f-0abc2367c49c service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:34.115195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f758-9841-47c1-bb0f-0abc2367c49c service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:34.115460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f758-9841-47c1-bb0f-0abc2367c49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:34.124693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51f758-9841-47c1-bb0f-0abc2367c49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:34.126169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51f758-9841-47c1-bb0f-0abc2367c49c service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:34.135835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 769/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:35:36.246660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b3fc-f935-49a4-a6ed-5168975a3b89 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:36.247216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b3fc-f935-49a4-a6ed-5168975a3b89 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:36.247216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2b3fc-f935-49a4-a6ed-5168975a3b89 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:36.249155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 03:35:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:35:36.257416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8062-aa7d-4948-8ce6-61696ba34427 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:36.257893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8062-aa7d-4948-8ce6-61696ba34427 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:36.258011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c8062-aa7d-4948-8ce6-61696ba34427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:36.278995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-362c8062-aa7d-4948-8ce6-61696ba34427 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:35:36.280193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-362c8062-aa7d-4948-8ce6-61696ba34427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:36.288708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 03:35:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:35:36.584930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2b3fc-f935-49a4-a6ed-5168975a3b89 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:35:36.586879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d2d2b3fc-f935-49a4-a6ed-5168975a3b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:35:36.595282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:35:36.603774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2b3fc-f935-49a4-a6ed-5168975a3b89 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:35:36.610630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb630b-99e8-468a-ba87-ed7c3c261426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:35:36.611515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb630b-99e8-468a-ba87-ed7c3c261426 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:35:36.611801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb630b-99e8-468a-ba87-ed7c3c261426 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:35:36.612167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb630b-99e8-468a-ba87-ed7c3c261426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:35:36.627325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb630b-99e8-468a-ba87-ed7c3c261426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:35:36.628773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb630b-99e8-468a-ba87-ed7c3c261426 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:35:36.639012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 769/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:35:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:35:46.274110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=11 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:35:46.634620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:01.306106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9142dda-5e03-4293-8e02-d4df5d85bc4d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.307506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9142dda-5e03-4293-8e02-d4df5d85bc4d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.307506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9142dda-5e03-4293-8e02-d4df5d85bc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.334819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c9142dda-5e03-4293-8e02-d4df5d85bc4d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:01.336156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c9142dda-5e03-4293-8e02-d4df5d85bc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:01.348737 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 771/1540] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:01.357646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804474-4753-420f-85ca-ccccafa8279a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.358239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804474-4753-420f-85ca-ccccafa8279a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.358239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804474-4753-420f-85ca-ccccafa8279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.386889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fc804474-4753-420f-85ca-ccccafa8279a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:01.388111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fc804474-4753-420f-85ca-ccccafa8279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:01.396536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 770/1541] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:01.401129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9142dda-5e03-4293-8e02-d4df5d85bc4d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:01.413229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9142dda-5e03-4293-8e02-d4df5d85bc4d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:01.418199 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:01.418810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.419085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.419351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.420000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:01.420300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:01.421933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:01.438879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 772/1542] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:01.446801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804474-4753-420f-85ca-ccccafa8279a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:01.456720 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804474-4753-420f-85ca-ccccafa8279a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:01.466742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000f999-a685-4b5a-86dc-8b0e44c7408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:01.467780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000f999-a685-4b5a-86dc-8b0e44c7408c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.468257 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000f999-a685-4b5a-86dc-8b0e44c7408c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.468722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000f999-a685-4b5a-86dc-8b0e44c7408c admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.469580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000f999-a685-4b5a-86dc-8b0e44c7408c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:01.471863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000f999-a685-4b5a-86dc-8b0e44c7408c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:01.536940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 771/1543] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:01 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:01.543566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:01.563962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89042ecb-536a-4457-9f6e-9aba1fcaf432 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:01.647541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420f91b-ad77-4304-ad11-af8dd0b9baa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:01.648177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420f91b-ad77-4304-ad11-af8dd0b9baa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.648454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420f91b-ad77-4304-ad11-af8dd0b9baa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.648725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a420f91b-ad77-4304-ad11-af8dd0b9baa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.649370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420f91b-ad77-4304-ad11-af8dd0b9baa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:01.651614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a420f91b-ad77-4304-ad11-af8dd0b9baa6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:01.687423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 773/1544] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:01 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:01.692244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000f999-a685-4b5a-86dc-8b0e44c7408c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:01.707494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000f999-a685-4b5a-86dc-8b0e44c7408c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:01.717304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90eea-a5d0-4a13-8201-9ed8bd932d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:01.718364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90eea-a5d0-4a13-8201-9ed8bd932d02 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.718869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90eea-a5d0-4a13-8201-9ed8bd932d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.719347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d90eea-a5d0-4a13-8201-9ed8bd932d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.720228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90eea-a5d0-4a13-8201-9ed8bd932d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:01.724753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d90eea-a5d0-4a13-8201-9ed8bd932d02 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:01.742463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 772/1545] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:01.746714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420f91b-ad77-4304-ad11-af8dd0b9baa6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:01.762527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a420f91b-ad77-4304-ad11-af8dd0b9baa6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:01.778685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f68b1f5-edfb-4fb6-9ddc-baeda067f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:01.779345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b1f5-edfb-4fb6-9ddc-baeda067f178 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.779629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b1f5-edfb-4fb6-9ddc-baeda067f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.779915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f68b1f5-edfb-4fb6-9ddc-baeda067f178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.780763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68b1f5-edfb-4fb6-9ddc-baeda067f178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:01.782734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f68b1f5-edfb-4fb6-9ddc-baeda067f178 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:01.804456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 774/1546] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:01.810002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90eea-a5d0-4a13-8201-9ed8bd932d02 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:01.838456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d90eea-a5d0-4a13-8201-9ed8bd932d02 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:01.848509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7231670-3f26-42b5-9e5f-8fa847259944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:01.849381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231670-3f26-42b5-9e5f-8fa847259944 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.849716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231670-3f26-42b5-9e5f-8fa847259944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.850068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7231670-3f26-42b5-9e5f-8fa847259944 admin admin] PATH_INFO: `/v3/projects/85552d7a5517459ebf4c55260bacd5c0/users/0da06a80220449fbad259cf76a8e0561/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.884106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7231670-3f26-42b5-9e5f-8fa847259944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85552d7a5517459ebf4c55260bacd5c0, user_id=0da06a80220449fbad259cf76a8e0561, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:01.887365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7231670-3f26-42b5-9e5f-8fa847259944 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:01.925022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 773/1547] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:01 2022] PUT /identity/v3/projects/85552d7a5517459ebf4c55260bacd5c0/users/0da06a80220449fbad259cf76a8e0561/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:01.930370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a589-334c-4404-b0d7-749e733b5e8b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:01.930711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a589-334c-4404-b0d7-749e733b5e8b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:01.930922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e106a589-334c-4404-b0d7-749e733b5e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:01.959576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e106a589-334c-4404-b0d7-749e733b5e8b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:01.960804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e106a589-334c-4404-b0d7-749e733b5e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.051770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c77b-57f2-4119-a985-d113737bc6b6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.052241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c77b-57f2-4119-a985-d113737bc6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.052520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7c77b-57f2-4119-a985-d113737bc6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.087526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 775/1548] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.094885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2ce7c77b-57f2-4119-a985-d113737bc6b6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.096369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2ce7c77b-57f2-4119-a985-d113737bc6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.104327 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a589-334c-4404-b0d7-749e733b5e8b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.131559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 774/1549] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:02.132918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48dcd-d02b-4416-83c3-57f3a9812aba None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.133203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48dcd-d02b-4416-83c3-57f3a9812aba None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.133474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b48dcd-d02b-4416-83c3-57f3a9812aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.175155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-83b48dcd-d02b-4416-83c3-57f3a9812aba None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.176386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-83b48dcd-d02b-4416-83c3-57f3a9812aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.189984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 775/1550] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.191217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04549f7-d813-4a5a-b15c-80f47e4760cf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.191499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04549f7-d813-4a5a-b15c-80f47e4760cf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.191774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04549f7-d813-4a5a-b15c-80f47e4760cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.212606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e106a589-334c-4404-b0d7-749e733b5e8b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.221559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f29927-2a55-46d1-8df4-307c1e4ad73e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.222228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29927-2a55-46d1-8df4-307c1e4ad73e service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.222503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29927-2a55-46d1-8df4-307c1e4ad73e service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.222865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f29927-2a55-46d1-8df4-307c1e4ad73e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.225254 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c04549f7-d813-4a5a-b15c-80f47e4760cf None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.226516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c04549f7-d813-4a5a-b15c-80f47e4760cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.242269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29927-2a55-46d1-8df4-307c1e4ad73e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.242642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 776/1551] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.243699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2409d-da57-4ad8-9291-e1126d186f2c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.243832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f29927-2a55-46d1-8df4-307c1e4ad73e service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.244280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2409d-da57-4ad8-9291-e1126d186f2c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.244699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2409d-da57-4ad8-9291-e1126d186f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.259921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 776/1552] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:37:02.261283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294016ae-82ff-4d6b-a4d9-81080ade3678 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.261873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294016ae-82ff-4d6b-a4d9-81080ade3678 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.262153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294016ae-82ff-4d6b-a4d9-81080ade3678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.279037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c5b2409d-da57-4ad8-9291-e1126d186f2c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.280265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c5b2409d-da57-4ad8-9291-e1126d186f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.280815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:02.305776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-294016ae-82ff-4d6b-a4d9-81080ade3678 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.307581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 777/1553] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.308186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-294016ae-82ff-4d6b-a4d9-81080ade3678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.308704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2409d-da57-4ad8-9291-e1126d186f2c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.319374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2409d-da57-4ad8-9291-e1126d186f2c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.319579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 777/1554] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.320749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a5fb6-7a32-47f5-a944-33fc4355fac6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.321039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a5fb6-7a32-47f5-a944-33fc4355fac6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.321581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a5fb6-7a32-47f5-a944-33fc4355fac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.331075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4db8a1-eb40-424b-b35c-f237117f42bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.331865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db8a1-eb40-424b-b35c-f237117f42bc admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.332133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db8a1-eb40-424b-b35c-f237117f42bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.332410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4db8a1-eb40-424b-b35c-f237117f42bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.333182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db8a1-eb40-424b-b35c-f237117f42bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:02.333492 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db8a1-eb40-424b-b35c-f237117f42bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.334621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-7f4db8a1-eb40-424b-b35c-f237117f42bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:37:02.334621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: warnings.warn(msg) Sep 17 03:37:02.334621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: Sep 17 03:37:02.335514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4db8a1-eb40-424b-b35c-f237117f42bc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.345936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-169a5fb6-7a32-47f5-a944-33fc4355fac6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.347732 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-169a5fb6-7a32-47f5-a944-33fc4355fac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.350756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 778/1555] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:02.352136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc58335-ffe3-4799-8efb-0c491e0eff87 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.352540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc58335-ffe3-4799-8efb-0c491e0eff87 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.352899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc58335-ffe3-4799-8efb-0c491e0eff87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.364513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 778/1556] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.364513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfeb61-0102-4b8b-aa77-2995c652ec7c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.364513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfeb61-0102-4b8b-aa77-2995c652ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.364513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfeb61-0102-4b8b-aa77-2995c652ec7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.395820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3cc58335-ffe3-4799-8efb-0c491e0eff87 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.397289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-11bfeb61-0102-4b8b-aa77-2995c652ec7c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.397409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3cc58335-ffe3-4799-8efb-0c491e0eff87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.399189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-11bfeb61-0102-4b8b-aa77-2995c652ec7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.411519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 779/1557] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.413938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc58335-ffe3-4799-8efb-0c491e0eff87 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.420457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 779/1558] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.420457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdffa8e-6db1-4e8c-85ea-848ecbd18514 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.420457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdffa8e-6db1-4e8c-85ea-848ecbd18514 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.420457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdffa8e-6db1-4e8c-85ea-848ecbd18514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.425476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc58335-ffe3-4799-8efb-0c491e0eff87 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.430242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca3a87-e98c-403a-b0ec-07b8c74f9ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.430860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca3a87-e98c-403a-b0ec-07b8c74f9ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.431136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca3a87-e98c-403a-b0ec-07b8c74f9ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.431410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca3a87-e98c-403a-b0ec-07b8c74f9ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.432179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca3a87-e98c-403a-b0ec-07b8c74f9ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:02.432479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca3a87-e98c-403a-b0ec-07b8c74f9ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.434441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca3a87-e98c-403a-b0ec-07b8c74f9ff3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.437893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1cdffa8e-6db1-4e8c-85ea-848ecbd18514 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.439216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1cdffa8e-6db1-4e8c-85ea-848ecbd18514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.447663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 780/1559] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.448513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdffa8e-6db1-4e8c-85ea-848ecbd18514 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.450282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 780/1560] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:02.452075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210bef-063d-4c31-a385-205f7a2b434b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.452589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210bef-063d-4c31-a385-205f7a2b434b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.452866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47210bef-063d-4c31-a385-205f7a2b434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.462417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdffa8e-6db1-4e8c-85ea-848ecbd18514 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.468276 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd48cf-d8b6-4fb5-b8ba-f1da8e6ad989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.469220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd48cf-d8b6-4fb5-b8ba-f1da8e6ad989 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.469359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd48cf-d8b6-4fb5-b8ba-f1da8e6ad989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.469620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd48cf-d8b6-4fb5-b8ba-f1da8e6ad989 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.471140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd48cf-d8b6-4fb5-b8ba-f1da8e6ad989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.471482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-cbcd48cf-d8b6-4fb5-b8ba-f1da8e6ad989 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:37:02.471482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: warnings.warn(msg) Sep 17 03:37:02.471482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: Sep 17 03:37:02.472832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd48cf-d8b6-4fb5-b8ba-f1da8e6ad989 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.476434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-47210bef-063d-4c31-a385-205f7a2b434b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.477726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-47210bef-063d-4c31-a385-205f7a2b434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.491418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 781/1561] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.491418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b1120-42e2-4703-9e3b-2939d17c4039 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.491418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b1120-42e2-4703-9e3b-2939d17c4039 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.491418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b1120-42e2-4703-9e3b-2939d17c4039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.515459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 781/1562] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/projects => generated 407 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:02.515459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ba81-1147-486d-9019-6fdbc759aef7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.515459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ba81-1147-486d-9019-6fdbc759aef7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.515459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7194ba81-1147-486d-9019-6fdbc759aef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.528188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-320b1120-42e2-4703-9e3b-2939d17c4039 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.529461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-320b1120-42e2-4703-9e3b-2939d17c4039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.536621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7194ba81-1147-486d-9019-6fdbc759aef7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.537957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7194ba81-1147-486d-9019-6fdbc759aef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.599451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 782/1563] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.607623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 782/1564] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.608719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ba81-1147-486d-9019-6fdbc759aef7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.611663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276db9f-990b-4ddf-9ade-e9839fda946c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.611956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276db9f-990b-4ddf-9ade-e9839fda946c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.612232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276db9f-990b-4ddf-9ade-e9839fda946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.618466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7194ba81-1147-486d-9019-6fdbc759aef7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.627197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.627842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.628142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.628415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.629112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:02.629412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.631615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.632964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b276db9f-990b-4ddf-9ade-e9839fda946c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.634208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b276db9f-990b-4ddf-9ade-e9839fda946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.647803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 783/1565] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.647803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276db9f-990b-4ddf-9ade-e9839fda946c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.648326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 783/1566] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:02.648326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.662802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276db9f-990b-4ddf-9ade-e9839fda946c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.663227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7666128-a80c-4946-9293-c1e984615bb2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.668804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c89b73-eb06-41fe-8f4a-451625d84837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.669371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89b73-eb06-41fe-8f4a-451625d84837 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.669888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89b73-eb06-41fe-8f4a-451625d84837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.670472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c89b73-eb06-41fe-8f4a-451625d84837 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.670599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.671964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c89b73-eb06-41fe-8f4a-451625d84837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.672098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.672098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.672098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.672777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:02.672998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.674053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c89b73-eb06-41fe-8f4a-451625d84837 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.674690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.690367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:02.691512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 784/1567] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:02.692181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.709401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd0589e-1f8b-4b7e-8a06-4fdfd45ae14e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.713944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 784/1568] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:02.715575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3c21-28e3-4d9f-b435-065f0ea4faf1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.715852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3c21-28e3-4d9f-b435-065f0ea4faf1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.716117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c3c21-28e3-4d9f-b435-065f0ea4faf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.719649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb90ef2-6bb7-4e4b-8c19-106134210a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.720440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90ef2-6bb7-4e4b-8c19-106134210a61 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.720778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90ef2-6bb7-4e4b-8c19-106134210a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.721055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb90ef2-6bb7-4e4b-8c19-106134210a61 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.721931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb90ef2-6bb7-4e4b-8c19-106134210a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.724380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb90ef2-6bb7-4e4b-8c19-106134210a61 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.749589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1c2c3c21-28e3-4d9f-b435-065f0ea4faf1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:02.752282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1c2c3c21-28e3-4d9f-b435-065f0ea4faf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:02.753375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 785/1569] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/users => generated 304 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:02.754962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb90ef2-6bb7-4e4b-8c19-106134210a61 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.767678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb90ef2-6bb7-4e4b-8c19-106134210a61 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.827964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 785/1570] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:02.832950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3c21-28e3-4d9f-b435-065f0ea4faf1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.838604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.840001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.840299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.840560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.841521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:02.841849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.843091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c3c21-28e3-4d9f-b435-065f0ea4faf1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.843770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.848471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.849815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.850027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.850298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.850985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:02.852005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.853314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.858281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 786/1571] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:02.859029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.866149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:02.871510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc53b8c-366a-48a6-8f04-b4a5c34b4e26 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.876179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 786/1572] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:02.877072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.886532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746d56-1ce0-45ba-bbe9-523d4d4fde3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.887243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746d56-1ce0-45ba-bbe9-523d4d4fde3e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.887589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864157bb-2829-41d6-b50e-8e07279e981e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:02.887709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746d56-1ce0-45ba-bbe9-523d4d4fde3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.887878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f746d56-1ce0-45ba-bbe9-523d4d4fde3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.888633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746d56-1ce0-45ba-bbe9-523d4d4fde3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.890670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f746d56-1ce0-45ba-bbe9-523d4d4fde3e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.892760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cfd18-3bf6-4a91-8703-4eff26116b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:02.893358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cfd18-3bf6-4a91-8703-4eff26116b57 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:02.893636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cfd18-3bf6-4a91-8703-4eff26116b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:02.893940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cfd18-3bf6-4a91-8703-4eff26116b57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:02.894576 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cfd18-3bf6-4a91-8703-4eff26116b57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:02.897197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cfd18-3bf6-4a91-8703-4eff26116b57 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:02.929628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 787/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:02.929628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cfd18-3bf6-4a91-8703-4eff26116b57 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.931653 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 787/1574] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:02.933028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746d56-1ce0-45ba-bbe9-523d4d4fde3e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:02.996892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cfd18-3bf6-4a91-8703-4eff26116b57 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.018130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f746d56-1ce0-45ba-bbe9-523d4d4fde3e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.023763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111af6b-7512-4eeb-9193-a651cc2e8a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.024857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111af6b-7512-4eeb-9193-a651cc2e8a1e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.025210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111af6b-7512-4eeb-9193-a651cc2e8a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.026678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111af6b-7512-4eeb-9193-a651cc2e8a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.027476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111af6b-7512-4eeb-9193-a651cc2e8a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.029302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111af6b-7512-4eeb-9193-a651cc2e8a1e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.040376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 788/1575] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.042986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111af6b-7512-4eeb-9193-a651cc2e8a1e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.058306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111af6b-7512-4eeb-9193-a651cc2e8a1e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.065352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.065985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.066266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.066667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.067310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:03.067610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.069201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.082989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 789/1576] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:03.090026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.090116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.090116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.090116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.090116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.090461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.090998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:37:03.090998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: warnings.warn(msg) Sep 17 03:37:03.090998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: Sep 17 03:37:03.092442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.097609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e85a2-c7fa-4e77-ad83-530a56198d79 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.104998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0f034-3bf3-45c3-9c8c-e03d75ca3ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.106050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:03.107155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0f034-3bf3-45c3-9c8c-e03d75ca3ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.107801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0f034-3bf3-45c3-9c8c-e03d75ca3ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.108363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c0f034-3bf3-45c3-9c8c-e03d75ca3ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.109349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0f034-3bf3-45c3-9c8c-e03d75ca3ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.112136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c0f034-3bf3-45c3-9c8c-e03d75ca3ad5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.121101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 788/1577] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:02 2022] POST /identity/v3/users => generated 284 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.122152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.136288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ec908-4482-455f-b1f3-fb67ee7dec2b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.143240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6339-15ff-4284-aed3-a5907db9a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.144061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6339-15ff-4284-aed3-a5907db9a9c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.144372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6339-15ff-4284-aed3-a5907db9a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.144656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e6339-15ff-4284-aed3-a5907db9a9c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.145341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e6339-15ff-4284-aed3-a5907db9a9c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.147387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e6339-15ff-4284-aed3-a5907db9a9c2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.157334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 790/1578] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.161485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0f034-3bf3-45c3-9c8c-e03d75ca3ad5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.186352 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 789/1579] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.187311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6339-15ff-4284-aed3-a5907db9a9c2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.248859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c0f034-3bf3-45c3-9c8c-e03d75ca3ad5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.263723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e6339-15ff-4284-aed3-a5907db9a9c2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.269772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a031c-d1ed-40ee-bbb4-d82d82cd5963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.270400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a031c-d1ed-40ee-bbb4-d82d82cd5963 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.270678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a031c-d1ed-40ee-bbb4-d82d82cd5963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.270947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a031c-d1ed-40ee-bbb4-d82d82cd5963 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.271587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a031c-d1ed-40ee-bbb4-d82d82cd5963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.273784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658a031c-d1ed-40ee-bbb4-d82d82cd5963 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.302667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 790/1580] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.303796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a031c-d1ed-40ee-bbb4-d82d82cd5963 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.316315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:03.320883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a031c-d1ed-40ee-bbb4-d82d82cd5963 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.329465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d189f5-ebfd-446e-b9ff-983ce69caa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.330272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d189f5-ebfd-446e-b9ff-983ce69caa0b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.330854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d189f5-ebfd-446e-b9ff-983ce69caa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.331230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d189f5-ebfd-446e-b9ff-983ce69caa0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.332053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d189f5-ebfd-446e-b9ff-983ce69caa0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.332886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a590b-c69a-4ed8-8866-acf91dd71e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.333953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d189f5-ebfd-446e-b9ff-983ce69caa0b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.334276 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a590b-c69a-4ed8-8866-acf91dd71e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.335936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a590b-c69a-4ed8-8866-acf91dd71e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.336286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a590b-c69a-4ed8-8866-acf91dd71e69 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.337521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a590b-c69a-4ed8-8866-acf91dd71e69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.339545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a590b-c69a-4ed8-8866-acf91dd71e69 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.351798 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 791/1581] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.352700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d189f5-ebfd-446e-b9ff-983ce69caa0b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.365647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d189f5-ebfd-446e-b9ff-983ce69caa0b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.365973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 791/1582] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.370728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9c07-666a-45b8-a848-478268515d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.371138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a590b-c69a-4ed8-8866-acf91dd71e69 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.371476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9c07-666a-45b8-a848-478268515d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.371754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9c07-666a-45b8-a848-478268515d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.372019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d9c07-666a-45b8-a848-478268515d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.372655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d9c07-666a-45b8-a848-478268515d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.374678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d9c07-666a-45b8-a848-478268515d61 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.384419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a590b-c69a-4ed8-8866-acf91dd71e69 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.390407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98ff4c-51d5-4b0b-8928-719a7feec462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.391060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98ff4c-51d5-4b0b-8928-719a7feec462 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.391471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98ff4c-51d5-4b0b-8928-719a7feec462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.391744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98ff4c-51d5-4b0b-8928-719a7feec462 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.392390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98ff4c-51d5-4b0b-8928-719a7feec462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.394319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98ff4c-51d5-4b0b-8928-719a7feec462 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.413087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 792/1583] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.413087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98ff4c-51d5-4b0b-8928-719a7feec462 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.422123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98ff4c-51d5-4b0b-8928-719a7feec462 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.425531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 792/1584] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.426763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9c07-666a-45b8-a848-478268515d61 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.503968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf249ea-a393-4cca-a270-50dafc0376c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.505886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf249ea-a393-4cca-a270-50dafc0376c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.506169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf249ea-a393-4cca-a270-50dafc0376c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.506456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf249ea-a393-4cca-a270-50dafc0376c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.507098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf249ea-a393-4cca-a270-50dafc0376c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.509460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf249ea-a393-4cca-a270-50dafc0376c8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.511617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d9c07-666a-45b8-a848-478268515d61 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.518467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d07ff7-e701-4138-aa2e-f44e4ba1b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.519112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d07ff7-e701-4138-aa2e-f44e4ba1b5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.519580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d07ff7-e701-4138-aa2e-f44e4ba1b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.519868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d07ff7-e701-4138-aa2e-f44e4ba1b5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.520622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d07ff7-e701-4138-aa2e-f44e4ba1b5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.522998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d07ff7-e701-4138-aa2e-f44e4ba1b5d3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.542998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 793/1585] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/users => generated 302 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.543873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf249ea-a393-4cca-a270-50dafc0376c8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.557690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 793/1586] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.557690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d07ff7-e701-4138-aa2e-f44e4ba1b5d3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.561237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf249ea-a393-4cca-a270-50dafc0376c8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.567014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d07ff7-e701-4138-aa2e-f44e4ba1b5d3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.569364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229847f-89df-4f0a-8dd5-a4064bb3d899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.569897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229847f-89df-4f0a-8dd5-a4064bb3d899 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.570185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229847f-89df-4f0a-8dd5-a4064bb3d899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.570458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229847f-89df-4f0a-8dd5-a4064bb3d899 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.571154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229847f-89df-4f0a-8dd5-a4064bb3d899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.572032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0821bb-7e50-4b53-a02e-0ee9f439d699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.572983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0821bb-7e50-4b53-a02e-0ee9f439d699 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.573113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0821bb-7e50-4b53-a02e-0ee9f439d699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.573294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0821bb-7e50-4b53-a02e-0ee9f439d699 admin admin] PATH_INFO: `/v3/projects/e484fa9975a34bb7b0e7957ecc26d783/users/ff4bf1e486024dc4956bad8d2ab81bef/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.573489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229847f-89df-4f0a-8dd5-a4064bb3d899 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.593728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 794/1587] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.595055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0821bb-7e50-4b53-a02e-0ee9f439d699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e484fa9975a34bb7b0e7957ecc26d783, user_id=ff4bf1e486024dc4956bad8d2ab81bef, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.595186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229847f-89df-4f0a-8dd5-a4064bb3d899 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.598298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0821bb-7e50-4b53-a02e-0ee9f439d699 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.603817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:03.609246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229847f-89df-4f0a-8dd5-a4064bb3d899 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.617836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdc4f-507d-4410-82f5-0fe33f3ef429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.619040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdc4f-507d-4410-82f5-0fe33f3ef429 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.619322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdc4f-507d-4410-82f5-0fe33f3ef429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.619665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bdc4f-507d-4410-82f5-0fe33f3ef429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.620475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bdc4f-507d-4410-82f5-0fe33f3ef429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.622178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bdc4f-507d-4410-82f5-0fe33f3ef429 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.625343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 794/1588] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:03 2022] PUT /identity/v3/projects/e484fa9975a34bb7b0e7957ecc26d783/users/ff4bf1e486024dc4956bad8d2ab81bef/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:03.626228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0821bb-7e50-4b53-a02e-0ee9f439d699 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.655330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 795/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.656207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdc4f-507d-4410-82f5-0fe33f3ef429 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.666510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bdc4f-507d-4410-82f5-0fe33f3ef429 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.711918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0821bb-7e50-4b53-a02e-0ee9f439d699 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.717873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70690d63-435e-480d-af6c-d4586e202bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.718500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690d63-435e-480d-af6c-d4586e202bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.718776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690d63-435e-480d-af6c-d4586e202bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.719230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70690d63-435e-480d-af6c-d4586e202bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.720376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70690d63-435e-480d-af6c-d4586e202bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.721862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70690d63-435e-480d-af6c-d4586e202bdc admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.738629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 795/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.738629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70690d63-435e-480d-af6c-d4586e202bdc admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.740780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1638ef-355d-4984-9c61-d1612a5102a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.742261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1638ef-355d-4984-9c61-d1612a5102a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.742954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1638ef-355d-4984-9c61-d1612a5102a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.743376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1638ef-355d-4984-9c61-d1612a5102a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.744386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1638ef-355d-4984-9c61-d1612a5102a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.746540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1638ef-355d-4984-9c61-d1612a5102a2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.748938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70690d63-435e-480d-af6c-d4586e202bdc admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.756185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9848f-a553-4f1e-bf95-749dee8686a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.757621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9848f-a553-4f1e-bf95-749dee8686a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.758464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9848f-a553-4f1e-bf95-749dee8686a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.758908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9848f-a553-4f1e-bf95-749dee8686a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.759691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9848f-a553-4f1e-bf95-749dee8686a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.762601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9848f-a553-4f1e-bf95-749dee8686a5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.774740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 796/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.776124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 796/1592] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:03.780039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9848f-a553-4f1e-bf95-749dee8686a5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.782168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1638ef-355d-4984-9c61-d1612a5102a2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.790110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9848f-a553-4f1e-bf95-749dee8686a5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.795130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ad89a-c0c0-4fa3-869a-a277044dd477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.795864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad89a-c0c0-4fa3-869a-a277044dd477 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.796203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad89a-c0c0-4fa3-869a-a277044dd477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.796540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ad89a-c0c0-4fa3-869a-a277044dd477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.796775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1638ef-355d-4984-9c61-d1612a5102a2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.797304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ad89a-c0c0-4fa3-869a-a277044dd477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.799311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5ad89a-c0c0-4fa3-869a-a277044dd477 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.804506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb431a-a3f5-4f1d-8270-1aeb09889103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.805853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb431a-a3f5-4f1d-8270-1aeb09889103 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.806772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb431a-a3f5-4f1d-8270-1aeb09889103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.807308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb431a-a3f5-4f1d-8270-1aeb09889103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.808475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb431a-a3f5-4f1d-8270-1aeb09889103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.810873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb431a-a3f5-4f1d-8270-1aeb09889103 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.811284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 797/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.811284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb28a91-7b81-4058-81a1-54d2b198f509 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.811284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb28a91-7b81-4058-81a1-54d2b198f509 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.811284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb28a91-7b81-4058-81a1-54d2b198f509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.830105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 797/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.831859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb431a-a3f5-4f1d-8270-1aeb09889103 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.848316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ceb28a91-7b81-4058-81a1-54d2b198f509 None None] MFA Rules not processed for user `ff4bf1e486024dc4956bad8d2ab81bef`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:03.849793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ceb28a91-7b81-4058-81a1-54d2b198f509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:03.850370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb431a-a3f5-4f1d-8270-1aeb09889103 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.858615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103328-f8d8-4a67-9baa-baa00c1f5e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.859408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103328-f8d8-4a67-9baa-baa00c1f5e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.859750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103328-f8d8-4a67-9baa-baa00c1f5e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.860111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48103328-f8d8-4a67-9baa-baa00c1f5e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.860874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48103328-f8d8-4a67-9baa-baa00c1f5e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.862982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48103328-f8d8-4a67-9baa-baa00c1f5e90 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.880801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 798/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:03.880801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103328-f8d8-4a67-9baa-baa00c1f5e90 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.887304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:03.892001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48103328-f8d8-4a67-9baa-baa00c1f5e90 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:03.907976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:03.909350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:03.917554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:03.917958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] PATH_INFO: `/v3/projects/d24d821be58545808ceac85895b370aa/users/d3a68f436b65477facf621a2b9ba6cbe/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:03.941644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24d821be58545808ceac85895b370aa, user_id=d3a68f436b65477facf621a2b9ba6cbe, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:03.942756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:37:03.942756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: warnings.warn(msg) Sep 17 03:37:03.942756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: Sep 17 03:37:03.945292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:03.964170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 799/1596] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:03 2022] PUT /identity/v3/projects/d24d821be58545808ceac85895b370aa/users/d3a68f436b65477facf621a2b9ba6cbe/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:03.964765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.975144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 798/1597] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:03.975144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb28a91-7b81-4058-81a1-54d2b198f509 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:03.998856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb28a91-7b81-4058-81a1-54d2b198f509 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.038059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830065fe-be64-4d98-a666-9a121912df17 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.043980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039350-93f3-4d4f-a843-24e50195ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.044607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039350-93f3-4d4f-a843-24e50195ec74 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.044886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039350-93f3-4d4f-a843-24e50195ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.045159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3039350-93f3-4d4f-a843-24e50195ec74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.045852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3039350-93f3-4d4f-a843-24e50195ec74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.047912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3039350-93f3-4d4f-a843-24e50195ec74 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.060948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 800/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:04.061964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039350-93f3-4d4f-a843-24e50195ec74 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.072167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3039350-93f3-4d4f-a843-24e50195ec74 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.074231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c966-62bd-4e1a-abc9-d4c988ee87cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.075436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c966-62bd-4e1a-abc9-d4c988ee87cd admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.075832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c966-62bd-4e1a-abc9-d4c988ee87cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.076179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4415c966-62bd-4e1a-abc9-d4c988ee87cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.076908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415c966-62bd-4e1a-abc9-d4c988ee87cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.078482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c90af-b672-4222-adb3-d77b47ea58aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.078630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4415c966-62bd-4e1a-abc9-d4c988ee87cd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.079452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c90af-b672-4222-adb3-d77b47ea58aa admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.079937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c90af-b672-4222-adb3-d77b47ea58aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.080547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38c90af-b672-4222-adb3-d77b47ea58aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.080880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:04.081211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c90af-b672-4222-adb3-d77b47ea58aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.083267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38c90af-b672-4222-adb3-d77b47ea58aa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.098256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 799/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:04.098256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c966-62bd-4e1a-abc9-d4c988ee87cd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.100696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 801/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:04.101471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c90af-b672-4222-adb3-d77b47ea58aa admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.112490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38c90af-b672-4222-adb3-d77b47ea58aa admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.117804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4415c966-62bd-4e1a-abc9-d4c988ee87cd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.120959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa080ae-13f5-4088-8128-183734739bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.174488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa080ae-13f5-4088-8128-183734739bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.174488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa080ae-13f5-4088-8128-183734739bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.174488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa080ae-13f5-4088-8128-183734739bb3 admin admin] PATH_INFO: `/v3/projects/f8869767df294cad94b72205e5e2845b/users/4ad24adf1244454292a8a225e40671fa/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.201111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f1e3f-98ef-48ec-9831-781b330f65c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.201111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1e3f-98ef-48ec-9831-781b330f65c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.201111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1e3f-98ef-48ec-9831-781b330f65c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.201111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f1e3f-98ef-48ec-9831-781b330f65c5 admin admin] PATH_INFO: `/v3/projects/25a144bb01964adfbf90cad355130767/users/5a24cec950e04aadb6dac9d525959e9e/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.201650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa080ae-13f5-4088-8128-183734739bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8869767df294cad94b72205e5e2845b, user_id=4ad24adf1244454292a8a225e40671fa, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.201650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa080ae-13f5-4088-8128-183734739bb3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.202337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f1e3f-98ef-48ec-9831-781b330f65c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25a144bb01964adfbf90cad355130767, user_id=5a24cec950e04aadb6dac9d525959e9e, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.202337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2f1e3f-98ef-48ec-9831-781b330f65c5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.202505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 802/1601] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:04 2022] PUT /identity/v3/projects/f8869767df294cad94b72205e5e2845b/users/4ad24adf1244454292a8a225e40671fa/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:04.202505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa080ae-13f5-4088-8128-183734739bb3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.202644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 800/1602] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:04 2022] PUT /identity/v3/projects/25a144bb01964adfbf90cad355130767/users/5a24cec950e04aadb6dac9d525959e9e/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:04.202644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e291d-d891-4b24-a984-7f93dda86037 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.202644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e291d-d891-4b24-a984-7f93dda86037 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.202644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e291d-d891-4b24-a984-7f93dda86037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.247075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f51e291d-d891-4b24-a984-7f93dda86037 None None] MFA Rules not processed for user `d3a68f436b65477facf621a2b9ba6cbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:04.248485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f51e291d-d891-4b24-a984-7f93dda86037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:04.288032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa080ae-13f5-4088-8128-183734739bb3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.341089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 801/1603] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:04.342841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e291d-d891-4b24-a984-7f93dda86037 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.352339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:04.369283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f03a-8ccc-4cb5-a185-2e8d9e541114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.370247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f03a-8ccc-4cb5-a185-2e8d9e541114 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.370628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f03a-8ccc-4cb5-a185-2e8d9e541114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.370999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90f03a-8ccc-4cb5-a185-2e8d9e541114 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.371882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90f03a-8ccc-4cb5-a185-2e8d9e541114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.374014 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90f03a-8ccc-4cb5-a185-2e8d9e541114 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.406602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 803/1604] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:04 2022] POST /identity/v3/projects => generated 409 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:04.406602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f03a-8ccc-4cb5-a185-2e8d9e541114 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.418682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e291d-d891-4b24-a984-7f93dda86037 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.479518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657d31c-a74a-4169-9618-57ec3c9d84c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.480259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90f03a-8ccc-4cb5-a185-2e8d9e541114 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.480376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657d31c-a74a-4169-9618-57ec3c9d84c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.480376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657d31c-a74a-4169-9618-57ec3c9d84c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.480727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657d31c-a74a-4169-9618-57ec3c9d84c4 admin admin] PATH_INFO: `/v3/projects/ade4cc8f4a5a42cfac44e90122f12c29/users/2bdc456f8ef74b9cbc711ceedd57eea0/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.484966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cf27-a527-4aec-8469-7da60bdf8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.485568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cf27-a527-4aec-8469-7da60bdf8e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.485876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cf27-a527-4aec-8469-7da60bdf8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.486148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129cf27-a527-4aec-8469-7da60bdf8e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.486790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129cf27-a527-4aec-8469-7da60bdf8e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.488397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129cf27-a527-4aec-8469-7da60bdf8e7d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.494043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:04.498150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657d31c-a74a-4169-9618-57ec3c9d84c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade4cc8f4a5a42cfac44e90122f12c29, user_id=2bdc456f8ef74b9cbc711ceedd57eea0, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.500877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 804/1605] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:04.501637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cf27-a527-4aec-8469-7da60bdf8e7d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.502228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657d31c-a74a-4169-9618-57ec3c9d84c4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.514200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129cf27-a527-4aec-8469-7da60bdf8e7d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.519261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 802/1606] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:04 2022] PUT /identity/v3/projects/ade4cc8f4a5a42cfac44e90122f12c29/users/2bdc456f8ef74b9cbc711ceedd57eea0/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:04.520674 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70914386-08a3-45b1-9e26-46fab285cacf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.521031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70914386-08a3-45b1-9e26-46fab285cacf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.521366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70914386-08a3-45b1-9e26-46fab285cacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.542624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-70914386-08a3-45b1-9e26-46fab285cacf None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:04.543953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-70914386-08a3-45b1-9e26-46fab285cacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:04.581322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8878c-51ae-415e-a6df-eac71ece7905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.582364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8878c-51ae-415e-a6df-eac71ece7905 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.582506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8878c-51ae-415e-a6df-eac71ece7905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.582752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8878c-51ae-415e-a6df-eac71ece7905 admin admin] PATH_INFO: `/v3/projects/0698e2851bae4d5b9762314487b34b99/users/a9ea14add7ae44139f089ae5b0a91ddf/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.599427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8878c-51ae-415e-a6df-eac71ece7905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0698e2851bae4d5b9762314487b34b99, user_id=a9ea14add7ae44139f089ae5b0a91ddf, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.602623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8878c-51ae-415e-a6df-eac71ece7905 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.612921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 803/1607] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:04.612921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105e9dd-4230-4dfb-9344-e8ff3d93b637 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.612921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105e9dd-4230-4dfb-9344-e8ff3d93b637 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.612921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8105e9dd-4230-4dfb-9344-e8ff3d93b637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.617405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 805/1608] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:04 2022] PUT /identity/v3/projects/0698e2851bae4d5b9762314487b34b99/users/a9ea14add7ae44139f089ae5b0a91ddf/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:04.618456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8878c-51ae-415e-a6df-eac71ece7905 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.645274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8105e9dd-4230-4dfb-9344-e8ff3d93b637 None None] MFA Rules not processed for user `4ad24adf1244454292a8a225e40671fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:04.646346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8105e9dd-4230-4dfb-9344-e8ff3d93b637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:04.693217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8878c-51ae-415e-a6df-eac71ece7905 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.697099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c793-b29f-4789-a3b9-7428b53b134f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.698752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c793-b29f-4789-a3b9-7428b53b134f service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.698752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c793-b29f-4789-a3b9-7428b53b134f service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.698752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2605c793-b29f-4789-a3b9-7428b53b134f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.703935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:04.719769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 804/1609] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:04.720702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105e9dd-4230-4dfb-9344-e8ff3d93b637 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.781463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605c793-b29f-4789-a3b9-7428b53b134f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.783274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2605c793-b29f-4789-a3b9-7428b53b134f service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.793532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 806/1610] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:04.794659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c793-b29f-4789-a3b9-7428b53b134f service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:04.804594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8105e9dd-4230-4dfb-9344-e8ff3d93b637 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.809336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2605c793-b29f-4789-a3b9-7428b53b134f service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:04.809825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c368342f-6b8d-4619-a22d-e70fb2da7c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.810456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368342f-6b8d-4619-a22d-e70fb2da7c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.810757 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368342f-6b8d-4619-a22d-e70fb2da7c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.811007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c368342f-6b8d-4619-a22d-e70fb2da7c95 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.811643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368342f-6b8d-4619-a22d-e70fb2da7c95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.813638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c368342f-6b8d-4619-a22d-e70fb2da7c95 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.816545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccae07-aad9-4044-bd44-bb382fb12b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:04.817395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccae07-aad9-4044-bd44-bb382fb12b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.817867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccae07-aad9-4044-bd44-bb382fb12b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.818283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccae07-aad9-4044-bd44-bb382fb12b01 admin admin] PATH_INFO: `/v3/projects/fc39540e3c13425797fca427caf460a5/users/f2f6fd1b96d44bde897fa70cfd5459f9/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.836553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccae07-aad9-4044-bd44-bb382fb12b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc39540e3c13425797fca427caf460a5, user_id=f2f6fd1b96d44bde897fa70cfd5459f9, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:04.841264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccae07-aad9-4044-bd44-bb382fb12b01 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:04.851763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 805/1611] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:04 2022] POST /identity/v3/users => generated 311 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:04.856782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dfba8-aa48-4f46-92d4-08874759f9e9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.857110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dfba8-aa48-4f46-92d4-08874759f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.857423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dfba8-aa48-4f46-92d4-08874759f9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.870684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 807/1612] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:04 2022] PUT /identity/v3/projects/fc39540e3c13425797fca427caf460a5/users/f2f6fd1b96d44bde897fa70cfd5459f9/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:04.871736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f9ae8-3ba3-4ee3-bc70-4cc6de499505 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:04.872020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f9ae8-3ba3-4ee3-bc70-4cc6de499505 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:04.872290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f9ae8-3ba3-4ee3-bc70-4cc6de499505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:04.883909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:04.903009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-587dfba8-aa48-4f46-92d4-08874759f9e9 None None] MFA Rules not processed for user `2bdc456f8ef74b9cbc711ceedd57eea0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:04.905293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-587dfba8-aa48-4f46-92d4-08874759f9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:04.941006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-148f9ae8-3ba3-4ee3-bc70-4cc6de499505 None None] MFA Rules not processed for user `a9ea14add7ae44139f089ae5b0a91ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:04.943189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-148f9ae8-3ba3-4ee3-bc70-4cc6de499505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:05.021340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 806/1613] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:05.022270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dfba8-aa48-4f46-92d4-08874759f9e9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:05.023833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-587dfba8-aa48-4f46-92d4-08874759f9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:05.077559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 808/1614] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:05.078606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f9ae8-3ba3-4ee3-bc70-4cc6de499505 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:05.147378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dfba8-aa48-4f46-92d4-08874759f9e9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:05.159304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdb071-3f7f-4e7e-b51b-485fb61a7143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:05.160463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb071-3f7f-4e7e-b51b-485fb61a7143 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.160954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb071-3f7f-4e7e-b51b-485fb61a7143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.161412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdb071-3f7f-4e7e-b51b-485fb61a7143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.232557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f9ae8-3ba3-4ee3-bc70-4cc6de499505 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:05.238480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9601c-896e-4ec9-99f9-b18665eed070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:05.239178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9601c-896e-4ec9-99f9-b18665eed070 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.239473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9601c-896e-4ec9-99f9-b18665eed070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.239812 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9601c-896e-4ec9-99f9-b18665eed070 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.240881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9601c-896e-4ec9-99f9-b18665eed070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:05.243451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9601c-896e-4ec9-99f9-b18665eed070 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:05.265248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdb071-3f7f-4e7e-b51b-485fb61a7143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:05.267643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdb071-3f7f-4e7e-b51b-485fb61a7143 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:05.273152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:05.303213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 809/1615] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:05 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:05.306199 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9601c-896e-4ec9-99f9-b18665eed070 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:05.317875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 807/1616] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:05.319296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7bde-c678-447d-8145-9ccc54e5dafb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.323096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7bde-c678-447d-8145-9ccc54e5dafb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.323273 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b7bde-c678-447d-8145-9ccc54e5dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.365846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-488b7bde-c678-447d-8145-9ccc54e5dafb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:05.367088 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-488b7bde-c678-447d-8145-9ccc54e5dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:05.398642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9601c-896e-4ec9-99f9-b18665eed070 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:05.409987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd2bf7-cc41-4c07-8360-0a90d9df10b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:05.410633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd2bf7-cc41-4c07-8360-0a90d9df10b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.410911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd2bf7-cc41-4c07-8360-0a90d9df10b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.411191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd2bf7-cc41-4c07-8360-0a90d9df10b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.411890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd2bf7-cc41-4c07-8360-0a90d9df10b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:05.413468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd2bf7-cc41-4c07-8360-0a90d9df10b3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:05.436760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:05.444229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 810/1617] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:05.444229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd2bf7-cc41-4c07-8360-0a90d9df10b3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:05.469532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 808/1618] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:05.471163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2503f-fc44-4c7c-9591-072986ee5e0f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.471457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2503f-fc44-4c7c-9591-072986ee5e0f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.471907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2503f-fc44-4c7c-9591-072986ee5e0f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.473651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd2bf7-cc41-4c07-8360-0a90d9df10b3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:05.479650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66f1e8-2035-4a20-bb96-1ed89fadf720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:05.480395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f1e8-2035-4a20-bb96-1ed89fadf720 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.480678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f1e8-2035-4a20-bb96-1ed89fadf720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.480950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66f1e8-2035-4a20-bb96-1ed89fadf720 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.481603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66f1e8-2035-4a20-bb96-1ed89fadf720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:05.484228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66f1e8-2035-4a20-bb96-1ed89fadf720 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:05.486011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 809/1619] 10.222.0.48 () {54 vars in 965 bytes} [Sat Sep 17 03:37:05 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:05.487088 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2503f-fc44-4c7c-9591-072986ee5e0f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:05.504383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2503f-fc44-4c7c-9591-072986ee5e0f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:05.514452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80def89-05e9-44d3-bb0a-f898f5bdc522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:05.515013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80def89-05e9-44d3-bb0a-f898f5bdc522 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.515292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80def89-05e9-44d3-bb0a-f898f5bdc522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.515586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80def89-05e9-44d3-bb0a-f898f5bdc522 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.516265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80def89-05e9-44d3-bb0a-f898f5bdc522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:05.518435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80def89-05e9-44d3-bb0a-f898f5bdc522 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:05.540892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 811/1620] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:05 2022] POST /identity/v3/projects => generated 405 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:05.540892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66f1e8-2035-4a20-bb96-1ed89fadf720 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:05.608633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 810/1621] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:05 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:05.612709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80def89-05e9-44d3-bb0a-f898f5bdc522 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:05.748421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66f1e8-2035-4a20-bb96-1ed89fadf720 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:05.753833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee471e4-3f5f-46ce-bbec-50cf9ef36fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:05.755603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee471e4-3f5f-46ce-bbec-50cf9ef36fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.756037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee471e4-3f5f-46ce-bbec-50cf9ef36fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.756969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee471e4-3f5f-46ce-bbec-50cf9ef36fc8 admin admin] PATH_INFO: `/v3/projects/2379cd56935f4a76829e412f72d47d7a/users/107bb26f88514c12b5b949b3c298dea6/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.796286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee471e4-3f5f-46ce-bbec-50cf9ef36fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2379cd56935f4a76829e412f72d47d7a, user_id=107bb26f88514c12b5b949b3c298dea6, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:05.801916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee471e4-3f5f-46ce-bbec-50cf9ef36fc8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:05.827574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 812/1622] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:05 2022] PUT /identity/v3/projects/2379cd56935f4a76829e412f72d47d7a/users/107bb26f88514c12b5b949b3c298dea6/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:05.830048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80def89-05e9-44d3-bb0a-f898f5bdc522 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:05.830409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fa7c6-0c2a-4574-bff7-349e9f41d008 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.830919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fa7c6-0c2a-4574-bff7-349e9f41d008 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.831634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fa7c6-0c2a-4574-bff7-349e9f41d008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.898099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-771fa7c6-0c2a-4574-bff7-349e9f41d008 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:05.900163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-771fa7c6-0c2a-4574-bff7-349e9f41d008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:05.960203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925383-23e7-4829-8315-b06b7dfafd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:05.961150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925383-23e7-4829-8315-b06b7dfafd9c service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:05.961430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925383-23e7-4829-8315-b06b7dfafd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:05.961716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6925383-23e7-4829-8315-b06b7dfafd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:05.965723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:06.021100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 813/1623] 10.222.0.48 () {58 vars in 1062 bytes} [Sat Sep 17 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:06.022124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fa7c6-0c2a-4574-bff7-349e9f41d008 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.115192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925383-23e7-4829-8315-b06b7dfafd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.116452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fa7c6-0c2a-4574-bff7-349e9f41d008 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.117177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6925383-23e7-4829-8315-b06b7dfafd9c service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.122497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f945a-7450-4f18-aefc-4b5509fc31ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.123121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f945a-7450-4f18-aefc-4b5509fc31ad admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.123492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f945a-7450-4f18-aefc-4b5509fc31ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.125196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f945a-7450-4f18-aefc-4b5509fc31ad admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.126574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f945a-7450-4f18-aefc-4b5509fc31ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.128837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f945a-7450-4f18-aefc-4b5509fc31ad admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.132221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 811/1624] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:06.133056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925383-23e7-4829-8315-b06b7dfafd9c service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.150156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6925383-23e7-4829-8315-b06b7dfafd9c service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.162952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c66a7-ab88-4161-be98-7672a1e31caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.165533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c66a7-ab88-4161-be98-7672a1e31caf admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.167876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c66a7-ab88-4161-be98-7672a1e31caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.167985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c66a7-ab88-4161-be98-7672a1e31caf admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.169504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c66a7-ab88-4161-be98-7672a1e31caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.171992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c66a7-ab88-4161-be98-7672a1e31caf admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.190712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 814/1625] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:06 2022] POST /identity/v3/users => generated 309 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:06.191667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f945a-7450-4f18-aefc-4b5509fc31ad admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.206213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 812/1626] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:06.208692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c66a7-ab88-4161-be98-7672a1e31caf admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.213116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f945a-7450-4f18-aefc-4b5509fc31ad admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.225406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e45193-9765-4b75-8559-a4dd11b622cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.227678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e45193-9765-4b75-8559-a4dd11b622cc admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.227955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e45193-9765-4b75-8559-a4dd11b622cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.228234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e45193-9765-4b75-8559-a4dd11b622cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.229095 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e45193-9765-4b75-8559-a4dd11b622cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.234912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e45193-9765-4b75-8559-a4dd11b622cc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.237523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c66a7-ab88-4161-be98-7672a1e31caf admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.253337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cce474-0a44-43fc-81bb-92230574b65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.255801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cce474-0a44-43fc-81bb-92230574b65a service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.257262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cce474-0a44-43fc-81bb-92230574b65a service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.260042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cce474-0a44-43fc-81bb-92230574b65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.272663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 815/1627] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:06.290703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e45193-9765-4b75-8559-a4dd11b622cc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.311897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e45193-9765-4b75-8559-a4dd11b622cc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.324837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391fe3c-9858-431c-84bb-8f186bdffc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.325468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391fe3c-9858-431c-84bb-8f186bdffc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.325741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391fe3c-9858-431c-84bb-8f186bdffc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.326033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5391fe3c-9858-431c-84bb-8f186bdffc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.330793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391fe3c-9858-431c-84bb-8f186bdffc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.332805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5391fe3c-9858-431c-84bb-8f186bdffc74 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.350571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:06.354452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 816/1628] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:06.361060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391fe3c-9858-431c-84bb-8f186bdffc74 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.384449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5391fe3c-9858-431c-84bb-8f186bdffc74 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.395521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39271ff6-e71a-4310-9417-065c9421c4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.399996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39271ff6-e71a-4310-9417-065c9421c4e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.400680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39271ff6-e71a-4310-9417-065c9421c4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.400813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39271ff6-e71a-4310-9417-065c9421c4e8 admin admin] PATH_INFO: `/v3/projects/75cc96e4f38f4f7b9f6acbb5c52d6fac/users/bf7029a78d0c4756a42c36f9f434386c/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.430417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39271ff6-e71a-4310-9417-065c9421c4e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cc96e4f38f4f7b9f6acbb5c52d6fac, user_id=bf7029a78d0c4756a42c36f9f434386c, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.433866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39271ff6-e71a-4310-9417-065c9421c4e8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.440333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cce474-0a44-43fc-81bb-92230574b65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.444511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cce474-0a44-43fc-81bb-92230574b65a service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.453603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 817/1629] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:06 2022] PUT /identity/v3/projects/75cc96e4f38f4f7b9f6acbb5c52d6fac/users/bf7029a78d0c4756a42c36f9f434386c/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:06.454755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39271ff6-e71a-4310-9417-065c9421c4e8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.466632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 813/1630] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:06.467449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cce474-0a44-43fc-81bb-92230574b65a service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.492230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cce474-0a44-43fc-81bb-92230574b65a service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.546279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39271ff6-e71a-4310-9417-065c9421c4e8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.552467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8524-0a97-4375-877a-3f733bcb6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.554137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8524-0a97-4375-877a-3f733bcb6b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.557458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8524-0a97-4375-877a-3f733bcb6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.558062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de8524-0a97-4375-877a-3f733bcb6b32 admin admin] PATH_INFO: `/v3/projects/2379cd56935f4a76829e412f72d47d7a/users/107bb26f88514c12b5b949b3c298dea6/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.563041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de8524-0a97-4375-877a-3f733bcb6b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2379cd56935f4a76829e412f72d47d7a, user_id=107bb26f88514c12b5b949b3c298dea6, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.572296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de8524-0a97-4375-877a-3f733bcb6b32 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.589815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 818/1631] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:06 2022] PUT /identity/v3/projects/2379cd56935f4a76829e412f72d47d7a/users/107bb26f88514c12b5b949b3c298dea6/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:06.591143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8524-0a97-4375-877a-3f733bcb6b32 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.617405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c55e40-d288-44b3-b8f6-1ba472a59656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.618245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c55e40-d288-44b3-b8f6-1ba472a59656 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.618581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c55e40-d288-44b3-b8f6-1ba472a59656 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.618851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c55e40-d288-44b3-b8f6-1ba472a59656 admin admin] PATH_INFO: `/v3/projects/efb9259c4f124302b7d1826562c909ff/users/63e01e4d4afe441382b3c7e904764bc9/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.623929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:06.639932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c55e40-d288-44b3-b8f6-1ba472a59656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb9259c4f124302b7d1826562c909ff, user_id=63e01e4d4afe441382b3c7e904764bc9, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.645434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c55e40-d288-44b3-b8f6-1ba472a59656 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.663583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 814/1632] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:06 2022] PUT /identity/v3/projects/efb9259c4f124302b7d1826562c909ff/users/63e01e4d4afe441382b3c7e904764bc9/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:06.665115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f1ba6-f632-4951-a04d-a78fa368b128 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.665622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f1ba6-f632-4951-a04d-a78fa368b128 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.666054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f1ba6-f632-4951-a04d-a78fa368b128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.725636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a41f1ba6-f632-4951-a04d-a78fa368b128 None None] MFA Rules not processed for user `107bb26f88514c12b5b949b3c298dea6`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:06.726903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a41f1ba6-f632-4951-a04d-a78fa368b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:06.739219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de8524-0a97-4375-877a-3f733bcb6b32 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.834517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a3f5e-2096-4f2e-9f62-b2057d6c8a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.835244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a3f5e-2096-4f2e-9f62-b2057d6c8a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.835541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a3f5e-2096-4f2e-9f62-b2057d6c8a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.836320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a3f5e-2096-4f2e-9f62-b2057d6c8a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.837091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a3f5e-2096-4f2e-9f62-b2057d6c8a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.839806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a3f5e-2096-4f2e-9f62-b2057d6c8a89 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.856907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 819/1633] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:06.858497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a3f5e-2096-4f2e-9f62-b2057d6c8a89 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.872548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a3f5e-2096-4f2e-9f62-b2057d6c8a89 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.878253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c414286-00c9-49eb-9738-670256a68d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.878973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c414286-00c9-49eb-9738-670256a68d93 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.879940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c414286-00c9-49eb-9738-670256a68d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.880316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c414286-00c9-49eb-9738-670256a68d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.881299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c414286-00c9-49eb-9738-670256a68d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.884756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c414286-00c9-49eb-9738-670256a68d93 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.898764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 820/1634] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:06.899797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c414286-00c9-49eb-9738-670256a68d93 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.908296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 815/1635] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:06 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:06.908755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f1ba6-f632-4951-a04d-a78fa368b128 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:06.912565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c414286-00c9-49eb-9738-670256a68d93 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.926902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f1ba6-f632-4951-a04d-a78fa368b128 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:06.931109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69cbc-9a2e-4f09-aa7c-4f161e66e65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.932237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69cbc-9a2e-4f09-aa7c-4f161e66e65b admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.932667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69cbc-9a2e-4f09-aa7c-4f161e66e65b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.932969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b69cbc-9a2e-4f09-aa7c-4f161e66e65b admin admin] PATH_INFO: `/v3/projects/75cc96e4f38f4f7b9f6acbb5c52d6fac/users/bf7029a78d0c4756a42c36f9f434386c/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.936526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b69cbc-9a2e-4f09-aa7c-4f161e66e65b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75cc96e4f38f4f7b9f6acbb5c52d6fac, user_id=bf7029a78d0c4756a42c36f9f434386c, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.940058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b69cbc-9a2e-4f09-aa7c-4f161e66e65b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.946934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e59bf9-3a45-4271-b4d9-5627a59ea08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:06.947710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e59bf9-3a45-4271-b4d9-5627a59ea08c admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:06.947989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e59bf9-3a45-4271-b4d9-5627a59ea08c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:06.948265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e59bf9-3a45-4271-b4d9-5627a59ea08c admin admin] PATH_INFO: `/v3/projects/efb9259c4f124302b7d1826562c909ff/users/63e01e4d4afe441382b3c7e904764bc9/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:06.953244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e59bf9-3a45-4271-b4d9-5627a59ea08c admin admin] RBAC: Authorizing `identity:create_grant(project_id=efb9259c4f124302b7d1826562c909ff, user_id=63e01e4d4afe441382b3c7e904764bc9, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:06.955504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 821/1636] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:06 2022] PUT /identity/v3/projects/75cc96e4f38f4f7b9f6acbb5c52d6fac/users/bf7029a78d0c4756a42c36f9f434386c/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:06.955956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e59bf9-3a45-4271-b4d9-5627a59ea08c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:06.956848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69cbc-9a2e-4f09-aa7c-4f161e66e65b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:07.014304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 816/1637] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:06 2022] PUT /identity/v3/projects/efb9259c4f124302b7d1826562c909ff/users/63e01e4d4afe441382b3c7e904764bc9/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:07.015876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87076-6932-4323-86a3-277213f82a64 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.016170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87076-6932-4323-86a3-277213f82a64 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.016447 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf87076-6932-4323-86a3-277213f82a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.069463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1cf87076-6932-4323-86a3-277213f82a64 None None] MFA Rules not processed for user `bf7029a78d0c4756a42c36f9f434386c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:07.071825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1cf87076-6932-4323-86a3-277213f82a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:07.095864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:07.103804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b69cbc-9a2e-4f09-aa7c-4f161e66e65b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:07.180336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:07.197638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c045a-1eb1-453f-aa3a-c1e24613c26d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:07.198466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c045a-1eb1-453f-aa3a-c1e24613c26d service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.198749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c045a-1eb1-453f-aa3a-c1e24613c26d service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.199065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c045a-1eb1-453f-aa3a-c1e24613c26d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.224670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 817/1638] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:07.228310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40afc5-fd41-46da-ad99-c632d13abe76 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.229237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40afc5-fd41-46da-ad99-c632d13abe76 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.229875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40afc5-fd41-46da-ad99-c632d13abe76 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.232359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 818/1639] 10.222.0.48 () {54 vars in 912 bytes} [Sat Sep 17 03:37:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:07.234679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b302d8-c8e0-42d9-9bdf-d278680f5c2c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.235206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b302d8-c8e0-42d9-9bdf-d278680f5c2c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.235698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b302d8-c8e0-42d9-9bdf-d278680f5c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.276492 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-05b302d8-c8e0-42d9-9bdf-d278680f5c2c None None] MFA Rules not processed for user `63e01e4d4afe441382b3c7e904764bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:07.277899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-05b302d8-c8e0-42d9-9bdf-d278680f5c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:07.294791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c045a-1eb1-453f-aa3a-c1e24613c26d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:07.296685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c045a-1eb1-453f-aa3a-c1e24613c26d service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:07.320011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 822/1640] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:06 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:07.322235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c045a-1eb1-453f-aa3a-c1e24613c26d service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:07.339643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c045a-1eb1-453f-aa3a-c1e24613c26d service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:07.348164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b4d81-c994-48b8-bcfc-011e72694d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:07.348811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b4d81-c994-48b8-bcfc-011e72694d10 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.349094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b4d81-c994-48b8-bcfc-011e72694d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.349470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b4d81-c994-48b8-bcfc-011e72694d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.399844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b4d81-c994-48b8-bcfc-011e72694d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:07.401455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b4d81-c994-48b8-bcfc-011e72694d10 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:07.429820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 819/1641] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:07.429820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1541ad-436c-490e-969f-07b66469b282 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.429820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1541ad-436c-490e-969f-07b66469b282 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.429820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1541ad-436c-490e-969f-07b66469b282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.430402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 823/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:07.440407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a661b-30fd-4b4c-9d77-b8268a7e4d69 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.440629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a661b-30fd-4b4c-9d77-b8268a7e4d69 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.440888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0a661b-30fd-4b4c-9d77-b8268a7e4d69 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.442607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 824/1643] 10.222.0.48 () {54 vars in 965 bytes} [Sat Sep 17 03:37:07 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:07.449146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7a13-fcc0-4140-a671-318ed53de192 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.451121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7a13-fcc0-4140-a671-318ed53de192 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.451463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b7a13-fcc0-4140-a671-318ed53de192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.459319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5a1541ad-436c-490e-969f-07b66469b282 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:07.460572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5a1541ad-436c-490e-969f-07b66469b282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:07.488639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-be5b7a13-fcc0-4140-a671-318ed53de192 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:07.490020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-be5b7a13-fcc0-4140-a671-318ed53de192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:07.594223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 820/1644] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:07.595040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1541ad-436c-490e-969f-07b66469b282 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:07.622143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1541ad-436c-490e-969f-07b66469b282 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:07.637837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac02b-26a4-48c6-9a72-4116d7827a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:07.639423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac02b-26a4-48c6-9a72-4116d7827a03 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.639751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac02b-26a4-48c6-9a72-4116d7827a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.640086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac02b-26a4-48c6-9a72-4116d7827a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.664442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ac02b-26a4-48c6-9a72-4116d7827a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:07.666310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ac02b-26a4-48c6-9a72-4116d7827a03 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:07.667198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 825/1645] 10.222.0.48 () {58 vars in 1062 bytes} [Sat Sep 17 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:07.673930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0504-abd0-4d43-9324-a1623c8e3b6a None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.674199 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0504-abd0-4d43-9324-a1623c8e3b6a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.674473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0504-abd0-4d43-9324-a1623c8e3b6a None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.679943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 826/1646] 10.222.0.48 () {54 vars in 912 bytes} [Sat Sep 17 03:37:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:07.687230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea0f9-0de7-425e-98bc-3f50764ff515 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.687583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea0f9-0de7-425e-98bc-3f50764ff515 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.687944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaea0f9-0de7-425e-98bc-3f50764ff515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.706165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 821/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:07.763742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-abaea0f9-0de7-425e-98bc-3f50764ff515 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:07.766122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-abaea0f9-0de7-425e-98bc-3f50764ff515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:07.781734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 827/1648] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:37:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:07.855523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac02b-26a4-48c6-9a72-4116d7827a03 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:07.867937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac02b-26a4-48c6-9a72-4116d7827a03 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:07.875871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649812e2-0e62-4f33-bbd2-7c32e0b436b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:07.876825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649812e2-0e62-4f33-bbd2-7c32e0b436b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.877991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649812e2-0e62-4f33-bbd2-7c32e0b436b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.878514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649812e2-0e62-4f33-bbd2-7c32e0b436b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.897278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaea0f9-0de7-425e-98bc-3f50764ff515 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:07.897972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649812e2-0e62-4f33-bbd2-7c32e0b436b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:07.900077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649812e2-0e62-4f33-bbd2-7c32e0b436b5 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:07.906172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:07.914522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 822/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:07.930572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaea0f9-0de7-425e-98bc-3f50764ff515 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:07.949724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd797-4aed-400c-84b9-d68f85143746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:07.951843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd797-4aed-400c-84b9-d68f85143746 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:07.952274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd797-4aed-400c-84b9-d68f85143746 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:07.952754 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134fd797-4aed-400c-84b9-d68f85143746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:07.985588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fd797-4aed-400c-84b9-d68f85143746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:07.987314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134fd797-4aed-400c-84b9-d68f85143746 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:08.059807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 828/1650] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:08.099538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649812e2-0e62-4f33-bbd2-7c32e0b436b5 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:08.114984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649812e2-0e62-4f33-bbd2-7c32e0b436b5 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:08.121573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614238c-8627-47b2-af0d-2f28355feb15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:08.122409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614238c-8627-47b2-af0d-2f28355feb15 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:08.122800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614238c-8627-47b2-af0d-2f28355feb15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:08.123232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614238c-8627-47b2-af0d-2f28355feb15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:08.277710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614238c-8627-47b2-af0d-2f28355feb15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:08.279831 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614238c-8627-47b2-af0d-2f28355feb15 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:08.307363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 823/1651] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:08 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:09.736351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd797-4aed-400c-84b9-d68f85143746 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:09.879596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:09.893527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134fd797-4aed-400c-84b9-d68f85143746 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:09.917364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:09.920419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:09.920690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:09.925322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] PATH_INFO: `/v3/users/2bdc456f8ef74b9cbc711ceedd57eea0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:09.930113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bdc456f8ef74b9cbc711ceedd57eea0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:09.931160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: WARNING py.warnings [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:37:09.931160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: warnings.warn(msg) Sep 17 03:37:09.931160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: Sep 17 03:37:09.932470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:10.095292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bdc456f8ef74b9cbc711ceedd57eea0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.096378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bdc456f8ef74b9cbc711ceedd57eea0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.115273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bdc456f8ef74b9cbc711ceedd57eea0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.149573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614238c-8627-47b2-af0d-2f28355feb15 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:10.161134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bdc456f8ef74b9cbc711ceedd57eea0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.162308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6a9ae528-eb3e-4b4f-be8a-4e21f6427a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bdc456f8ef74b9cbc711ceedd57eea0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.167905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614238c-8627-47b2-af0d-2f28355feb15 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:10.179527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:10.180093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:10.180243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:10.180659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] PATH_INFO: `/v3/users/4ad24adf1244454292a8a225e40671fa` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:10.187099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 829/1652] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:09 2022] DELETE /identity/v3/users/2bdc456f8ef74b9cbc711ceedd57eea0 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:10.191259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad24adf1244454292a8a225e40671fa)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:10.191430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b45a9-6cb5-4d93-9374-385af11e5766 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:10.191841 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b45a9-6cb5-4d93-9374-385af11e5766 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:10.192204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b45a9-6cb5-4d93-9374-385af11e5766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:10.194646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:10.217353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e63b45a9-6cb5-4d93-9374-385af11e5766 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:10.218653 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e63b45a9-6cb5-4d93-9374-385af11e5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:10.287880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad24adf1244454292a8a225e40671fa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.289331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad24adf1244454292a8a225e40671fa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.298414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 830/1653] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:10.308942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad24adf1244454292a8a225e40671fa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.315842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b45a9-6cb5-4d93-9374-385af11e5766 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:10.318365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e63b45a9-6cb5-4d93-9374-385af11e5766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:10.319443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad24adf1244454292a8a225e40671fa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.320162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ede7ed21-2f8a-440b-91b7-807438a56d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad24adf1244454292a8a225e40671fa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:10.340520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 824/1654] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:10 2022] DELETE /identity/v3/users/4ad24adf1244454292a8a225e40671fa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:10.345664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b83e1-3148-48e5-9c04-02745e248613 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:10.346239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b83e1-3148-48e5-9c04-02745e248613 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:10.346512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b83e1-3148-48e5-9c04-02745e248613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:10.395511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c23b83e1-3148-48e5-9c04-02745e248613 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:10.397158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c23b83e1-3148-48e5-9c04-02745e248613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:10.478338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b45a9-6cb5-4d93-9374-385af11e5766 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:10.536242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 825/1655] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:10.560801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b83e1-3148-48e5-9c04-02745e248613 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:10.562745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c23b83e1-3148-48e5-9c04-02745e248613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:10.578568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:10.581160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:10.646527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:10.647171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:10.647900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:10.647900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:10.650963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:10.666284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b83e1-3148-48e5-9c04-02745e248613 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:10.670245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896669e-88c7-4f9e-bfab-d7b4f7fc8e97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:10.670877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896669e-88c7-4f9e-bfab-d7b4f7fc8e97 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:10.671159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896669e-88c7-4f9e-bfab-d7b4f7fc8e97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:10.673034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896669e-88c7-4f9e-bfab-d7b4f7fc8e97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:10.684289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896669e-88c7-4f9e-bfab-d7b4f7fc8e97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:10.685598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:10.685830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896669e-88c7-4f9e-bfab-d7b4f7fc8e97 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:10.688744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:10.702378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 826/1656] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:10.708813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f591b-550d-42a9-8a89-b158e8477a61 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:10.709206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f591b-550d-42a9-8a89-b158e8477a61 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:10.709513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f591b-550d-42a9-8a89-b158e8477a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:10.712139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 831/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:10.776991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b13f591b-550d-42a9-8a89-b158e8477a61 None None] MFA Rules not processed for user `0da06a80220449fbad259cf76a8e0561`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:10.778403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b13f591b-550d-42a9-8a89-b158e8477a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:10.935119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 827/1658] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:10.952788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:10.955065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:11.286849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4f7c3-9c69-455c-a933-ec5399f99441 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:11.301550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:11.302661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:11.303129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:11.303573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:11.329492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:11.334079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:11.368642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 832/1659] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:12.186104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f591b-550d-42a9-8a89-b158e8477a61 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:12.191207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b13f591b-550d-42a9-8a89-b158e8477a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:12.233131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f591b-550d-42a9-8a89-b158e8477a61 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:12.247995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:12.248487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:12.249516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:12.253502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:12.253812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:12.254093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] PATH_INFO: `/v3/users/a9ea14add7ae44139f089ae5b0a91ddf` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:12.256261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ea14add7ae44139f089ae5b0a91ddf)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:12.258272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:12.274922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bee4b-2941-4dcd-9d0d-3bf93c9ac0d8 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:12.288609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:12.292320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:12.292647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:12.292924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] PATH_INFO: `/v3/projects/f8869767df294cad94b72205e5e2845b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:12.297294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8869767df294cad94b72205e5e2845b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:12.302054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:12.403066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ea14add7ae44139f089ae5b0a91ddf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.404448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ea14add7ae44139f089ae5b0a91ddf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.432063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8869767df294cad94b72205e5e2845b', 'request_id': 'req-4bc6711b-de76-479d-a4bc-23906192bbd3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.433570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ea14add7ae44139f089ae5b0a91ddf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.441702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8869767df294cad94b72205e5e2845b', 'request_id': 'req-4bc6711b-de76-479d-a4bc-23906192bbd3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.456108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ea14add7ae44139f089ae5b0a91ddf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.458904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5b872a2f-642f-4425-b00a-e9f564deba12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ea14add7ae44139f089ae5b0a91ddf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.459049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8869767df294cad94b72205e5e2845b', 'request_id': 'req-4bc6711b-de76-479d-a4bc-23906192bbd3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.491297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] The token cache is being invalidate because project f8869767df294cad94b72205e5e2845b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:12.491676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.493460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.496660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 833/1660] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:12 2022] DELETE /identity/v3/projects/f8869767df294cad94b72205e5e2845b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:12.501548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:12.505064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:12.530602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 828/1661] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:12 2022] DELETE /identity/v3/users/a9ea14add7ae44139f089ae5b0a91ddf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:12.535482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6d385-8aeb-4e3a-adff-9f4ad7c6f26b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:12.541374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6d385-8aeb-4e3a-adff-9f4ad7c6f26b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:12.542226 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6d385-8aeb-4e3a-adff-9f4ad7c6f26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:12.605031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8af6d385-8aeb-4e3a-adff-9f4ad7c6f26b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:12.606109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:12.609809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8af6d385-8aeb-4e3a-adff-9f4ad7c6f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:12.631917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:12.648601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6711b-de76-479d-a4bc-23906192bbd3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:12.792097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:12.796167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:12.796167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:12.796397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 829/1662] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:12.796478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] PATH_INFO: `/v3/users/bf7029a78d0c4756a42c36f9f434386c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:12.796478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7029a78d0c4756a42c36f9f434386c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:12.797686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:12.808307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6d385-8aeb-4e3a-adff-9f4ad7c6f26b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:12.810278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8af6d385-8aeb-4e3a-adff-9f4ad7c6f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:12.880202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7029a78d0c4756a42c36f9f434386c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.881601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7029a78d0c4756a42c36f9f434386c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.904409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7029a78d0c4756a42c36f9f434386c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.943622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7029a78d0c4756a42c36f9f434386c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.947401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7029a78d0c4756a42c36f9f434386c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:12.985444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 834/1663] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:12 2022] DELETE /identity/v3/users/bf7029a78d0c4756a42c36f9f434386c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:12.998917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6d385-8aeb-4e3a-adff-9f4ad7c6f26b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:13.164731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:13.165419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:13.165705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:13.166243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:13.178387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:13.387128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:13.389857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:13.417720 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 830/1664] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:37:13.814065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:13.815932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:13.846533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff8afe-d772-4652-9afc-e3106720c591 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:13.855462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:13.856453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:13.856912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:13.857370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] PATH_INFO: `/v3/projects/ade4cc8f4a5a42cfac44e90122f12c29` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:13.861529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade4cc8f4a5a42cfac44e90122f12c29)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:13.863935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:13.966544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade4cc8f4a5a42cfac44e90122f12c29', 'request_id': 'req-3cead917-a96b-46a1-a590-94bb8e1b9f98'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:13.981223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade4cc8f4a5a42cfac44e90122f12c29', 'request_id': 'req-3cead917-a96b-46a1-a590-94bb8e1b9f98'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.001491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade4cc8f4a5a42cfac44e90122f12c29', 'request_id': 'req-3cead917-a96b-46a1-a590-94bb8e1b9f98'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.009023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:14.030248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] The token cache is being invalidate because project ade4cc8f4a5a42cfac44e90122f12c29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:14.038156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.039547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.042997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 835/1665] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:13 2022] DELETE /identity/v3/projects/ade4cc8f4a5a42cfac44e90122f12c29 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:14.047250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:14.074701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5671c4-db23-40dc-8753-e58c80779b21 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:14.130719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:14.257658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:14.258615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:14.259092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:14.259549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] PATH_INFO: `/v3/users/63e01e4d4afe441382b3c7e904764bc9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:14.261008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=63e01e4d4afe441382b3c7e904764bc9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:14.263911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:14.389446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63e01e4d4afe441382b3c7e904764bc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.391485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63e01e4d4afe441382b3c7e904764bc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.404718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63e01e4d4afe441382b3c7e904764bc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.416509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63e01e4d4afe441382b3c7e904764bc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.417290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63e01e4d4afe441382b3c7e904764bc9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:14.501600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 831/1666] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:14 2022] DELETE /identity/v3/users/63e01e4d4afe441382b3c7e904764bc9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:15.290375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:15.292735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:15.310463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cead917-a96b-46a1-a590-94bb8e1b9f98 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:15.489084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:15.490037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:15.490584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:15.490979 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] PATH_INFO: `/v3/projects/75cc96e4f38f4f7b9f6acbb5c52d6fac` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:15.492789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75cc96e4f38f4f7b9f6acbb5c52d6fac)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:15.495290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:15.578644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:15.580102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:15.599889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75cc96e4f38f4f7b9f6acbb5c52d6fac', 'request_id': 'req-f3aaa181-2ce6-433e-87da-a23c0a85e144'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:15.608793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a89ef-6ea8-4083-b700-e782003a10dd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:15.620299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75cc96e4f38f4f7b9f6acbb5c52d6fac', 'request_id': 'req-f3aaa181-2ce6-433e-87da-a23c0a85e144'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:15.643557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75cc96e4f38f4f7b9f6acbb5c52d6fac', 'request_id': 'req-f3aaa181-2ce6-433e-87da-a23c0a85e144'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:15.681070 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] The token cache is being invalidate because project 75cc96e4f38f4f7b9f6acbb5c52d6fac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:15.681390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:15.684714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3aaa181-2ce6-433e-87da-a23c0a85e144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:15.692694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 836/1667] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:15 2022] DELETE /identity/v3/projects/75cc96e4f38f4f7b9f6acbb5c52d6fac => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:15.696616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ddc35-880e-46f9-87ae-33a77384c728 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:15.698934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ddc35-880e-46f9-87ae-33a77384c728 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:15.699250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ddc35-880e-46f9-87ae-33a77384c728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:15.749386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-880ddc35-880e-46f9-87ae-33a77384c728 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:15.752002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-880ddc35-880e-46f9-87ae-33a77384c728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:15.786797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:15.787489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:15.787774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:15.788054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] PATH_INFO: `/v3/projects/efb9259c4f124302b7d1826562c909ff` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:15.790956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efb9259c4f124302b7d1826562c909ff)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:15.794241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: WARNING py.warnings [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 03:37:15.794241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: warnings.warn(msg) Sep 17 03:37:15.794241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: Sep 17 03:37:15.795662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:15.890912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:15.893360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 837/1668] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:15.897140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ddc35-880e-46f9-87ae-33a77384c728 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:15.900337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-880ddc35-880e-46f9-87ae-33a77384c728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:15.928326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efb9259c4f124302b7d1826562c909ff', 'request_id': 'req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:15.940470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ddc35-880e-46f9-87ae-33a77384c728 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:15.944607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efb9259c4f124302b7d1826562c909ff', 'request_id': 'req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:15.976131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efb9259c4f124302b7d1826562c909ff', 'request_id': 'req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:15.987488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:16.010132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] The token cache is being invalidate because project efb9259c4f124302b7d1826562c909ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:16.010428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.012070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fcc3e7d6-ddea-4263-9d41-f5ab30a6ef11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.015566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 832/1669] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:15 2022] DELETE /identity/v3/projects/efb9259c4f124302b7d1826562c909ff => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:16.016550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778792-56c3-4840-95f6-f341a22b82e4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:16.016833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778792-56c3-4840-95f6-f341a22b82e4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:16.020582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778792-56c3-4840-95f6-f341a22b82e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:16.068556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c4778792-56c3-4840-95f6-f341a22b82e4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:16.071597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c4778792-56c3-4840-95f6-f341a22b82e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:16.132426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:16.133176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:16.133461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:16.134023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] PATH_INFO: `/v3/users/ff4bf1e486024dc4956bad8d2ab81bef` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:16.136549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff4bf1e486024dc4956bad8d2ab81bef)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:16.139016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:16.220158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 833/1670] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:16.226046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e723-af36-4c5e-8073-ccdbaf7c0948 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:16.226046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e723-af36-4c5e-8073-ccdbaf7c0948 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:16.226046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024e723-af36-4c5e-8073-ccdbaf7c0948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:16.271481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3024e723-af36-4c5e-8073-ccdbaf7c0948 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:16.284478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3024e723-af36-4c5e-8073-ccdbaf7c0948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:16.301290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff4bf1e486024dc4956bad8d2ab81bef'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.303215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff4bf1e486024dc4956bad8d2ab81bef'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.314281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 834/1671] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:16.316947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e723-af36-4c5e-8073-ccdbaf7c0948 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:16.328701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff4bf1e486024dc4956bad8d2ab81bef'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.348916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024e723-af36-4c5e-8073-ccdbaf7c0948 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:16.358012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff4bf1e486024dc4956bad8d2ab81bef'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.361436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff4bf1e486024dc4956bad8d2ab81bef'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.363098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4694728-889e-48ed-a054-fe992514eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:16.364282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4694728-889e-48ed-a054-fe992514eead admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:16.364567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4694728-889e-48ed-a054-fe992514eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:16.366509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4694728-889e-48ed-a054-fe992514eead admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:16.368236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4694728-889e-48ed-a054-fe992514eead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:16.368541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4694728-889e-48ed-a054-fe992514eead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:16.374438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4694728-889e-48ed-a054-fe992514eead admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:16.396611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 838/1672] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:15 2022] DELETE /identity/v3/users/ff4bf1e486024dc4956bad8d2ab81bef => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:16.397587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:16.400804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:16.407400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 835/1673] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:16.415138 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3031eac-2d0c-4ef4-81fe-0342b6625022 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:16.415445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3031eac-2d0c-4ef4-81fe-0342b6625022 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:16.418337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3031eac-2d0c-4ef4-81fe-0342b6625022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:16.467822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d3031eac-2d0c-4ef4-81fe-0342b6625022 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:16.469465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d3031eac-2d0c-4ef4-81fe-0342b6625022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:16.603181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cafdf2-accb-47f1-8670-2361f56975a6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:16.621092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:16.621824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:16.622048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:16.622312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] PATH_INFO: `/v3/projects/0698e2851bae4d5b9762314487b34b99` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:16.631049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0698e2851bae4d5b9762314487b34b99)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:16.632771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:16.668746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 836/1674] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:16.670205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29cb2-dbfb-4929-8bbf-2541ec74b005 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:16.670637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29cb2-dbfb-4929-8bbf-2541ec74b005 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:16.671111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a29cb2-dbfb-4929-8bbf-2541ec74b005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:16.701797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-07a29cb2-dbfb-4929-8bbf-2541ec74b005 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:16.702966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-07a29cb2-dbfb-4929-8bbf-2541ec74b005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:16.717114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 837/1675] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:16.717114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a29cb2-dbfb-4929-8bbf-2541ec74b005 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:16.718695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-07a29cb2-dbfb-4929-8bbf-2541ec74b005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:16.741794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a29cb2-dbfb-4929-8bbf-2541ec74b005 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:16.741936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:16.751864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0698e2851bae4d5b9762314487b34b99', 'request_id': 'req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.763419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0698e2851bae4d5b9762314487b34b99', 'request_id': 'req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.778056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0698e2851bae4d5b9762314487b34b99', 'request_id': 'req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.798765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] The token cache is being invalidate because project 0698e2851bae4d5b9762314487b34b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:16.799455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.801712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:16.804787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 839/1676] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:16 2022] DELETE /identity/v3/projects/0698e2851bae4d5b9762314487b34b99 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:16.805974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:16.808527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:16.827946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:16.860175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:16.861172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:16.861773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:16.862240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:16.863086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:16.867402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:16.929487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 838/1677] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:16 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:16.929487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:16.937059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:17.007233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae44b0f-4fe0-4a2a-89be-788dd8a512e5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.030225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee2612-2482-4eed-abde-1c92a543dbe4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.034555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.035519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.035964 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.036413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.038704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:17.132849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3912-e8df-4688-a50b-a82c91db8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.134235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3912-e8df-4688-a50b-a82c91db8caa admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.134621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3912-e8df-4688-a50b-a82c91db8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.134930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3912-e8df-4688-a50b-a82c91db8caa admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.136003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3912-e8df-4688-a50b-a82c91db8caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:17.136923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3912-e8df-4688-a50b-a82c91db8caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.140189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3912-e8df-4688-a50b-a82c91db8caa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.156183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 840/1678] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:17.161382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3079d-6d1f-469b-939f-06934ec32e43 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.161662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3079d-6d1f-469b-939f-06934ec32e43 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.161954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3079d-6d1f-469b-939f-06934ec32e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.167131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.168802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.181075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 839/1679] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:17.183000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.184882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:17.185298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-90c3079d-6d1f-469b-939f-06934ec32e43 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:17.186513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90c3079d-6d1f-469b-939f-06934ec32e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:17.195564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 841/1680] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:17.196921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832327-d389-42fb-a945-66b7fef9598a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.197200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832327-d389-42fb-a945-66b7fef9598a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.197471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb832327-d389-42fb-a945-66b7fef9598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.209281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068ba8d-84e6-46cd-a2c5-86f1b48d1a15 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.216317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb7e70-07f2-42d1-9a14-0186062d7185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.217081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb7e70-07f2-42d1-9a14-0186062d7185 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.217362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb7e70-07f2-42d1-9a14-0186062d7185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.217632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb7e70-07f2-42d1-9a14-0186062d7185 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.218365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb7e70-07f2-42d1-9a14-0186062d7185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.220819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb7e70-07f2-42d1-9a14-0186062d7185 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.222129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fb832327-d389-42fb-a945-66b7fef9598a None None] MFA Rules not processed for user `0da06a80220449fbad259cf76a8e0561`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:17.223655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fb832327-d389-42fb-a945-66b7fef9598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:17.259237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 840/1681] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:17 2022] POST /identity/v3/users => generated 283 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:17.260113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb7e70-07f2-42d1-9a14-0186062d7185 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.289790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb7e70-07f2-42d1-9a14-0186062d7185 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.312371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 842/1682] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:17.314966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03bcc-2155-4f6c-acc5-5c00b1a3ed9d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.315259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03bcc-2155-4f6c-acc5-5c00b1a3ed9d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.315937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d03bcc-2155-4f6c-acc5-5c00b1a3ed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.326368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0c33b-492c-482a-aca8-745f0d0c0ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.326636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c33b-492c-482a-aca8-745f0d0c0ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.326912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c33b-492c-482a-aca8-745f0d0c0ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.327181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c33b-492c-482a-aca8-745f0d0c0ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.327826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0c33b-492c-482a-aca8-745f0d0c0ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.330053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0c33b-492c-482a-aca8-745f0d0c0ec2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.377593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c8d03bcc-2155-4f6c-acc5-5c00b1a3ed9d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:17.380551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c8d03bcc-2155-4f6c-acc5-5c00b1a3ed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:17.394443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 841/1683] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:17 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:17.395336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0c33b-492c-482a-aca8-745f0d0c0ec2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.405162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:17.490200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:17.506002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 843/1684] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:17.509425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d03bcc-2155-4f6c-acc5-5c00b1a3ed9d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.530828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d03bcc-2155-4f6c-acc5-5c00b1a3ed9d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.544390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4711-1fd0-4416-913a-34a1b5d6fa60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.545038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4711-1fd0-4416-913a-34a1b5d6fa60 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.546299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0c33b-492c-482a-aca8-745f0d0c0ec2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.547023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4711-1fd0-4416-913a-34a1b5d6fa60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.547247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc4711-1fd0-4416-913a-34a1b5d6fa60 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.547916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc4711-1fd0-4416-913a-34a1b5d6fa60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.557287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc4711-1fd0-4416-913a-34a1b5d6fa60 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.558411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6656970-a150-45dd-8399-8f7638b516e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.559046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656970-a150-45dd-8399-8f7638b516e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.559328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656970-a150-45dd-8399-8f7638b516e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.559600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6656970-a150-45dd-8399-8f7638b516e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.560253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6656970-a150-45dd-8399-8f7638b516e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.561911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6656970-a150-45dd-8399-8f7638b516e3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.599928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 842/1685] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:17.603463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6656970-a150-45dd-8399-8f7638b516e3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.621151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 844/1686] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:17 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:17.625223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4711-1fd0-4416-913a-34a1b5d6fa60 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.643535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6656970-a150-45dd-8399-8f7638b516e3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.649101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.649781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.650121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.650393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.651053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:17.651356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.652978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.667097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc4711-1fd0-4416-913a-34a1b5d6fa60 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.677373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 843/1687] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:17.678101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.685153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85f696-5046-4d1e-aed8-e996e5149983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.686093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f696-5046-4d1e-aed8-e996e5149983 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.686375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f696-5046-4d1e-aed8-e996e5149983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.687000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85f696-5046-4d1e-aed8-e996e5149983 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.687677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85f696-5046-4d1e-aed8-e996e5149983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.688930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85f696-5046-4d1e-aed8-e996e5149983 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.697633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f38e8-5db8-434a-8b9e-745b43b7be79 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.717618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597f420-c80c-4566-92db-a1fef06593b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.718298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597f420-c80c-4566-92db-a1fef06593b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.718554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597f420-c80c-4566-92db-a1fef06593b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.718826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597f420-c80c-4566-92db-a1fef06593b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.719473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597f420-c80c-4566-92db-a1fef06593b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.721099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597f420-c80c-4566-92db-a1fef06593b6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.728476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 845/1688] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:17.729835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85f696-5046-4d1e-aed8-e996e5149983 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.744097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85f696-5046-4d1e-aed8-e996e5149983 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.777777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0a117-68c4-4d51-8cad-7273907ab223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.779182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0a117-68c4-4d51-8cad-7273907ab223 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.779427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0a117-68c4-4d51-8cad-7273907ab223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.779734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0a117-68c4-4d51-8cad-7273907ab223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.780438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0a117-68c4-4d51-8cad-7273907ab223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.782628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0a117-68c4-4d51-8cad-7273907ab223 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.783685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 844/1689] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:17.784536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597f420-c80c-4566-92db-a1fef06593b6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.820835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597f420-c80c-4566-92db-a1fef06593b6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:17.838355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e4ddb-172b-4429-927f-ac7b36d46e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:17.839054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e4ddb-172b-4429-927f-ac7b36d46e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:17.839331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e4ddb-172b-4429-927f-ac7b36d46e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:17.839610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615e4ddb-172b-4429-927f-ac7b36d46e06 admin admin] PATH_INFO: `/v3/projects/bf95a6cef5bd4d0ba46261600257fdf4/users/37a19615b22f40689b3174b7ac5da78c/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:17.871618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 846/1690] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:17 2022] POST /identity/v3/projects => generated 381 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:17.872912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0a117-68c4-4d51-8cad-7273907ab223 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:17.889660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e4ddb-172b-4429-927f-ac7b36d46e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf95a6cef5bd4d0ba46261600257fdf4, user_id=37a19615b22f40689b3174b7ac5da78c, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:17.892440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615e4ddb-172b-4429-927f-ac7b36d46e06 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:17.936341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 845/1691] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:17 2022] PUT /identity/v3/projects/bf95a6cef5bd4d0ba46261600257fdf4/users/37a19615b22f40689b3174b7ac5da78c/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:17.937214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e4ddb-172b-4429-927f-ac7b36d46e06 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:18.042981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0a117-68c4-4d51-8cad-7273907ab223 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:18.068412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615e4ddb-172b-4429-927f-ac7b36d46e06 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:18.074467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e9112-d6bd-4638-958b-d68e7f3286ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:18.075099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e9112-d6bd-4638-958b-d68e7f3286ea admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.075379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e9112-d6bd-4638-958b-d68e7f3286ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.075649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e9112-d6bd-4638-958b-d68e7f3286ea admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.076297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e9112-d6bd-4638-958b-d68e7f3286ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:18.078329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e9112-d6bd-4638-958b-d68e7f3286ea admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:18.120666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 846/1692] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:17 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:18.120666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e143-58a2-4d39-a9ec-61490ce52383 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.120666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e143-58a2-4d39-a9ec-61490ce52383 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.125149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7e143-58a2-4d39-a9ec-61490ce52383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.138502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52ba75-3559-4ef5-baf6-d3ea555859e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:18.139138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52ba75-3559-4ef5-baf6-d3ea555859e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.139871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52ba75-3559-4ef5-baf6-d3ea555859e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.140158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52ba75-3559-4ef5-baf6-d3ea555859e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.141407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52ba75-3559-4ef5-baf6-d3ea555859e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:18.144584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e52ba75-3559-4ef5-baf6-d3ea555859e1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:18.172435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 847/1693] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:18.173987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52ba75-3559-4ef5-baf6-d3ea555859e1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:18.182763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5ea7e143-58a2-4d39-a9ec-61490ce52383 None None] MFA Rules not processed for user `37a19615b22f40689b3174b7ac5da78c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:18.184010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5ea7e143-58a2-4d39-a9ec-61490ce52383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:18.184242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:18.192059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52ba75-3559-4ef5-baf6-d3ea555859e1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:18.199669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66da1-37d4-40a5-8c73-23cbd0e3a8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:18.200351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66da1-37d4-40a5-8c73-23cbd0e3a8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.201081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66da1-37d4-40a5-8c73-23cbd0e3a8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.201392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66da1-37d4-40a5-8c73-23cbd0e3a8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.202604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa66da1-37d4-40a5-8c73-23cbd0e3a8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:18.204382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa66da1-37d4-40a5-8c73-23cbd0e3a8a5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:18.224157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 848/1694] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:18.224157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66da1-37d4-40a5-8c73-23cbd0e3a8a5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:18.241032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66da1-37d4-40a5-8c73-23cbd0e3a8a5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:18.251710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea7faf-ddb1-41ca-a6f4-8e61c44e1a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:18.254911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea7faf-ddb1-41ca-a6f4-8e61c44e1a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.255186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea7faf-ddb1-41ca-a6f4-8e61c44e1a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.256026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea7faf-ddb1-41ca-a6f4-8e61c44e1a06 admin admin] PATH_INFO: `/v3/projects/2edc42ba99374102bbdfbe348ee203f3/users/d8fb50032ec14a2b926551c9c2b7f658/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.278091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea7faf-ddb1-41ca-a6f4-8e61c44e1a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edc42ba99374102bbdfbe348ee203f3, user_id=d8fb50032ec14a2b926551c9c2b7f658, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:18.280949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea7faf-ddb1-41ca-a6f4-8e61c44e1a06 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:18.302704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 849/1695] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:18 2022] PUT /identity/v3/projects/2edc42ba99374102bbdfbe348ee203f3/users/d8fb50032ec14a2b926551c9c2b7f658/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:18.304099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea7faf-ddb1-41ca-a6f4-8e61c44e1a06 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:18.386400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 847/1696] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:18.387085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7e143-58a2-4d39-a9ec-61490ce52383 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:18.390918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5ea7e143-58a2-4d39-a9ec-61490ce52383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:18.407443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea7faf-ddb1-41ca-a6f4-8e61c44e1a06 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:18.413647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad7ab2-bda3-418d-96c5-3648ef48f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:18.414613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7ab2-bda3-418d-96c5-3648ef48f5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.414613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7ab2-bda3-418d-96c5-3648ef48f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.414872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad7ab2-bda3-418d-96c5-3648ef48f5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.416134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad7ab2-bda3-418d-96c5-3648ef48f5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:18.418738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad7ab2-bda3-418d-96c5-3648ef48f5f0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:18.426646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7e143-58a2-4d39-a9ec-61490ce52383 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:18.431469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 850/1697] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:18.433057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7debd9-3fe3-4744-a1c7-5875f5ee1324 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.433350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7debd9-3fe3-4744-a1c7-5875f5ee1324 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.433869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7debd9-3fe3-4744-a1c7-5875f5ee1324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.438370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:18.439026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.439303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.439574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] PATH_INFO: `/v3/projects/e484fa9975a34bb7b0e7957ecc26d783` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.441797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e484fa9975a34bb7b0e7957ecc26d783)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:18.453468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:18.458843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:18.469636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2b7debd9-3fe3-4744-a1c7-5875f5ee1324 None None] MFA Rules not processed for user `d8fb50032ec14a2b926551c9c2b7f658`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:18.470993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2b7debd9-3fe3-4744-a1c7-5875f5ee1324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:18.558804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 851/1698] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:18.560124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1543a-47ca-4352-b335-ddd85c01fe9b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.560415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1543a-47ca-4352-b335-ddd85c01fe9b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.560688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f1543a-47ca-4352-b335-ddd85c01fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.579027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e484fa9975a34bb7b0e7957ecc26d783', 'request_id': 'req-03b5c4f9-964f-4363-be1d-cc27c6ff451a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:18.596937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e484fa9975a34bb7b0e7957ecc26d783', 'request_id': 'req-03b5c4f9-964f-4363-be1d-cc27c6ff451a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:18.597883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-95f1543a-47ca-4352-b335-ddd85c01fe9b None None] MFA Rules not processed for user `f2f6fd1b96d44bde897fa70cfd5459f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:18.599261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-95f1543a-47ca-4352-b335-ddd85c01fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:18.611367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e484fa9975a34bb7b0e7957ecc26d783', 'request_id': 'req-03b5c4f9-964f-4363-be1d-cc27c6ff451a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:18.637037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] The token cache is being invalidate because project e484fa9975a34bb7b0e7957ecc26d783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:18.637335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:18.639917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-03b5c4f9-964f-4363-be1d-cc27c6ff451a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:18.642687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 848/1699] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:18 2022] DELETE /identity/v3/projects/e484fa9975a34bb7b0e7957ecc26d783 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:18.645307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33059b6-3063-4709-a9c5-84b69ecd7d2c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.645594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33059b6-3063-4709-a9c5-84b69ecd7d2c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.647502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33059b6-3063-4709-a9c5-84b69ecd7d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.663531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:18.705449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 852/1700] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:18.706506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1543a-47ca-4352-b335-ddd85c01fe9b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:18.715172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-95f1543a-47ca-4352-b335-ddd85c01fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:18.723023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c33059b6-3063-4709-a9c5-84b69ecd7d2c None None] MFA Rules not processed for user `5a24cec950e04aadb6dac9d525959e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:18.724713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c33059b6-3063-4709-a9c5-84b69ecd7d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:18.847659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f1543a-47ca-4352-b335-ddd85c01fe9b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:18.852472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:18.853325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:18.853675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:18.854087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:18.854811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:18.857003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:18.878716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 849/1701] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:18.880429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33059b6-3063-4709-a9c5-84b69ecd7d2c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:18.893048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c33059b6-3063-4709-a9c5-84b69ecd7d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:18.914311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33059b6-3063-4709-a9c5-84b69ecd7d2c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:18.915417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 853/1702] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:18 2022] POST /identity/v3/projects => generated 365 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:18.916910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:18.919316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:19.005910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:19.007176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.007756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.008207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] PATH_INFO: `/v3/projects/8adbdf078fca4620ba1f4c377aff346e/users/abd51900f99b4f70b314dbb9546cfd8a/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.017535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131535f0-5f11-4736-bc30-1c14fe50da21 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:19.023053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:19.024387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.024859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.025676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.026872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:19.029128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:19.032149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adbdf078fca4620ba1f4c377aff346e, user_id=abd51900f99b4f70b314dbb9546cfd8a, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:19.035712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:19.058437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 850/1703] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:18 2022] PUT /identity/v3/projects/8adbdf078fca4620ba1f4c377aff346e/users/abd51900f99b4f70b314dbb9546cfd8a/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:19.060006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:19.062344 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:19.068013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 854/1704] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:18 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:19.068013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:19.070244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:19.072882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:19.226880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:19.231237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e786af-37b8-4bce-acc2-be54f88691a3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:19.236622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547fe85a-42b3-4183-9b0c-f19582af35f6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:19.244006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:19.245056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.245515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.248822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] PATH_INFO: `/v3/users/d3a68f436b65477facf621a2b9ba6cbe` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.252008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a68f436b65477facf621a2b9ba6cbe)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:19.255502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:19.255928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:19.256597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.257387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.257730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] PATH_INFO: `/v3/users/107bb26f88514c12b5b949b3c298dea6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.259362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=107bb26f88514c12b5b949b3c298dea6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:19.261930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:19.336481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a68f436b65477facf621a2b9ba6cbe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.337162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a68f436b65477facf621a2b9ba6cbe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.348451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a68f436b65477facf621a2b9ba6cbe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.369034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a68f436b65477facf621a2b9ba6cbe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.372051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a68f436b65477facf621a2b9ba6cbe'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.374709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107bb26f88514c12b5b949b3c298dea6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.375590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107bb26f88514c12b5b949b3c298dea6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.391194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107bb26f88514c12b5b949b3c298dea6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.395010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 855/1705] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:19 2022] DELETE /identity/v3/users/d3a68f436b65477facf621a2b9ba6cbe => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:19.396018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:19.398172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:19.408648 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107bb26f88514c12b5b949b3c298dea6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.409155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-69f6e768-7c4e-4ffc-bd72-1f63a982c23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107bb26f88514c12b5b949b3c298dea6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:19.437389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 851/1706] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:19 2022] DELETE /identity/v3/users/107bb26f88514c12b5b949b3c298dea6 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:19.439010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa410a-1729-4cd8-8530-58bbb1314761 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.440386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa410a-1729-4cd8-8530-58bbb1314761 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.441467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa410a-1729-4cd8-8530-58bbb1314761 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.453700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 852/1707] 10.222.0.48 () {54 vars in 912 bytes} [Sat Sep 17 03:37:19 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:19.455264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a957-daa6-4ff0-a1d2-dcc4c56b8ef3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.455837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a957-daa6-4ff0-a1d2-dcc4c56b8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.456456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa0a957-daa6-4ff0-a1d2-dcc4c56b8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.499296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bfa0a957-daa6-4ff0-a1d2-dcc4c56b8ef3 None None] MFA Rules not processed for user `5a24cec950e04aadb6dac9d525959e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:19.501845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bfa0a957-daa6-4ff0-a1d2-dcc4c56b8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:19.514681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40acea-3ae7-48e5-95c5-26c5b3a9b669 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:19.635212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 853/1708] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:19.636096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a957-daa6-4ff0-a1d2-dcc4c56b8ef3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:19.643059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bfa0a957-daa6-4ff0-a1d2-dcc4c56b8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:19.677179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:19.677953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.678413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.678662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.682472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:19.708619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:19.733492 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:19.824759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:19.826443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:19.838435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 856/1709] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:19.839452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:19.841087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:19.886696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4a28-54ea-457d-8062-79d0fabc6c34 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:19.888578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa0a957-daa6-4ff0-a1d2-dcc4c56b8ef3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:19.893202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d880b3c-89cb-4625-b4d8-8eef566fe81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:19.894466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880b3c-89cb-4625-b4d8-8eef566fe81f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.894950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880b3c-89cb-4625-b4d8-8eef566fe81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.895368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d880b3c-89cb-4625-b4d8-8eef566fe81f admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.896147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d880b3c-89cb-4625-b4d8-8eef566fe81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:19.899666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304ae7-60fa-4dd4-851e-6886393ff479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:19.900057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d880b3c-89cb-4625-b4d8-8eef566fe81f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:19.901578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304ae7-60fa-4dd4-851e-6886393ff479 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.901987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304ae7-60fa-4dd4-851e-6886393ff479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.902380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304ae7-60fa-4dd4-851e-6886393ff479 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.904117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9304ae7-60fa-4dd4-851e-6886393ff479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:19.922723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9304ae7-60fa-4dd4-851e-6886393ff479 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:19.957185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 857/1710] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:19 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:19.959628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6907-fb1e-4622-9ae2-ec4d58192c09 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.961881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6907-fb1e-4622-9ae2-ec4d58192c09 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.962239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d6907-fb1e-4622-9ae2-ec4d58192c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:19.990137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 854/1711] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:19 2022] POST /identity/v3/users => generated 289 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:19.991442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef3381-400a-46a0-b57e-d5768491abc1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:19.991762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef3381-400a-46a0-b57e-d5768491abc1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:19.991998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ef3381-400a-46a0-b57e-d5768491abc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.025320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ab2d6907-fb1e-4622-9ae2-ec4d58192c09 None None] MFA Rules not processed for user `abd51900f99b4f70b314dbb9546cfd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:20.027184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab2d6907-fb1e-4622-9ae2-ec4d58192c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.039235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-97ef3381-400a-46a0-b57e-d5768491abc1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:20.040560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-97ef3381-400a-46a0-b57e-d5768491abc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.057531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 855/1712] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:20.067886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90530b7-9239-41bd-9a29-6646d0c24375 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.068142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90530b7-9239-41bd-9a29-6646d0c24375 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.068426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90530b7-9239-41bd-9a29-6646d0c24375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.158777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a90530b7-9239-41bd-9a29-6646d0c24375 None None] MFA Rules not processed for user `18061b868be44122a849e2e239b56f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:20.159573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 858/1713] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:20.160019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a90530b7-9239-41bd-9a29-6646d0c24375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.160809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6907-fb1e-4622-9ae2-ec4d58192c09 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.201132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d6907-fb1e-4622-9ae2-ec4d58192c09 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:20.216280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9820160-e00c-4451-a308-2810f482c645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:20.217043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9820160-e00c-4451-a308-2810f482c645 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.217205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9820160-e00c-4451-a308-2810f482c645 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.217624 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9820160-e00c-4451-a308-2810f482c645 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.218380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9820160-e00c-4451-a308-2810f482c645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:20.220155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9820160-e00c-4451-a308-2810f482c645 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:20.270681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 859/1714] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:20.271703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9820160-e00c-4451-a308-2810f482c645 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.293296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9820160-e00c-4451-a308-2810f482c645 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:20.300975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:20.301718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.302064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.303736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.306911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:20.308842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:20.332789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 860/1715] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:20.334018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.337145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.347551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 856/1716] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:37:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:20.356171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90530b7-9239-41bd-9a29-6646d0c24375 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.366355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a90530b7-9239-41bd-9a29-6646d0c24375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.370494 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a0907-3bdf-430f-a724-a5e236412270 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:20.384259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:20.384498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.384783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.385056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.387753 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.425849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:20.429302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:20.436839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90530b7-9239-41bd-9a29-6646d0c24375 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:20.451559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:20.452425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.452833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.453209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.455349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 861/1717] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:20.456552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.458074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.475124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fd6fc-346a-408a-b7a6-ffa11de3d080 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:20.483594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:20.484475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.484925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.485342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] PATH_INFO: `/v3/projects/2379cd56935f4a76829e412f72d47d7a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.486015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:20.489445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:20.492288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2379cd56935f4a76829e412f72d47d7a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:20.505870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:20.506340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 857/1718] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:20.507371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.513057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.546029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbc5040-2ea3-447b-b4eb-98a836412166 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:20.557495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a0c2b-5def-4764-b34b-09c93f3c29ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:20.558320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a0c2b-5def-4764-b34b-09c93f3c29ac admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.558701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a0c2b-5def-4764-b34b-09c93f3c29ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.559069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a0c2b-5def-4764-b34b-09c93f3c29ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.560037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a0c2b-5def-4764-b34b-09c93f3c29ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:20.562695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a0c2b-5def-4764-b34b-09c93f3c29ac admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:20.609989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:20.631505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2379cd56935f4a76829e412f72d47d7a', 'request_id': 'req-859e2163-de98-4c6f-98c1-eddd7455a17f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:20.652066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 858/1719] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:20 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:20.653394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a0c2b-5def-4764-b34b-09c93f3c29ac admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.660076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2379cd56935f4a76829e412f72d47d7a', 'request_id': 'req-859e2163-de98-4c6f-98c1-eddd7455a17f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:20.683941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2379cd56935f4a76829e412f72d47d7a', 'request_id': 'req-859e2163-de98-4c6f-98c1-eddd7455a17f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:20.727942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] The token cache is being invalidate because project 2379cd56935f4a76829e412f72d47d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:20.728453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:20.730152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:20.735905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 862/1720] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:20 2022] DELETE /identity/v3/projects/2379cd56935f4a76829e412f72d47d7a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:20.743733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.747090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.833728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a0c2b-5def-4764-b34b-09c93f3c29ac admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:20.855551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:20.860281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.860709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.861101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] PATH_INFO: `/v3/projects/efcea8d402ae4fa993f0aa2938eb4b28/users/13893d6b85214d42a8eff0be892fd338/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.886555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcea8d402ae4fa993f0aa2938eb4b28, user_id=13893d6b85214d42a8eff0be892fd338, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:20.890714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:20.895161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:20.897037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e2163-de98-4c6f-98c1-eddd7455a17f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:20.905516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:20.906287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:20.911938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:20.912627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] PATH_INFO: `/v3/projects/08ae24306ce5408ba4b7327eafa94d68/users/65d7d03b079e4fbb97bcab64ecf34dd3/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:20.923804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 859/1721] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:20 2022] PUT /identity/v3/projects/efcea8d402ae4fa993f0aa2938eb4b28/users/13893d6b85214d42a8eff0be892fd338/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:20.925075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:20.927392 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:20.948255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ae24306ce5408ba4b7327eafa94d68, user_id=65d7d03b079e4fbb97bcab64ecf34dd3, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:20.954414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:20.998314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 863/1722] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:20 2022] PUT /identity/v3/projects/08ae24306ce5408ba4b7327eafa94d68/users/65d7d03b079e4fbb97bcab64ecf34dd3/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:21.002156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.009021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.047197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eced115-a1a8-437f-af13-e6b14e1d49d7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.120078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b4e4c-785a-4a79-bb1a-109f38578c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.121112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b4e4c-785a-4a79-bb1a-109f38578c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.121562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b4e4c-785a-4a79-bb1a-109f38578c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.121987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b4e4c-785a-4a79-bb1a-109f38578c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.124616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-802b4e4c-785a-4a79-bb1a-109f38578c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.124958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a3c67-6310-4a5f-a391-b4f4f5460748 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.137478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.138043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.138374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.138655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.139968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.145063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.157611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b4e4c-785a-4a79-bb1a-109f38578c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.160211 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b4e4c-785a-4a79-bb1a-109f38578c2f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.172194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 860/1723] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:21.174135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9853062-faca-4812-bf25-ab9c23540c0f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.175264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9853062-faca-4812-bf25-ab9c23540c0f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.175547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9853062-faca-4812-bf25-ab9c23540c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.196356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 864/1724] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:20 2022] POST /identity/v3/users => generated 296 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:21.197902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.200364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.214213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f9853062-faca-4812-bf25-ab9c23540c0f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:21.215618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f9853062-faca-4812-bf25-ab9c23540c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.217002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a62ca-dd03-4273-adcd-1f26b5c73eaa admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.227275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 861/1725] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:21.228403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9853062-faca-4812-bf25-ab9c23540c0f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.236404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b1a78-878b-4900-94e4-a99214651cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.237147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b1a78-878b-4900-94e4-a99214651cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.237425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b1a78-878b-4900-94e4-a99214651cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.237871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b1a78-878b-4900-94e4-a99214651cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.238734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b1a78-878b-4900-94e4-a99214651cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.240106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9853062-faca-4812-bf25-ab9c23540c0f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.240317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b1a78-878b-4900-94e4-a99214651cd5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.245574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c9319-c1c0-422d-b6c2-62445eee3a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.246372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9319-c1c0-422d-b6c2-62445eee3a80 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.246796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9319-c1c0-422d-b6c2-62445eee3a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.247553 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c9319-c1c0-422d-b6c2-62445eee3a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.248419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c9319-c1c0-422d-b6c2-62445eee3a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.250384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c9319-c1c0-422d-b6c2-62445eee3a80 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.254357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 865/1726] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:21.256000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caf298-cc2d-47e0-b948-9d889592a0fc None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.256340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caf298-cc2d-47e0-b948-9d889592a0fc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.256627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caf298-cc2d-47e0-b948-9d889592a0fc None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.258676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 866/1727] 10.222.0.48 () {54 vars in 912 bytes} [Sat Sep 17 03:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:21.259493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caf298-cc2d-47e0-b948-9d889592a0fc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.267005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 862/1728] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:21.268480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9f68-57fe-414b-a120-36a7ad6cbcfa None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.269189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9f68-57fe-414b-a120-36a7ad6cbcfa None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.269189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af9f68-57fe-414b-a120-36a7ad6cbcfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.283335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caf298-cc2d-47e0-b948-9d889592a0fc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.290467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53351808-025a-4a4c-841c-23bd5be6bca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.291105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53351808-025a-4a4c-841c-23bd5be6bca1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.291383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53351808-025a-4a4c-841c-23bd5be6bca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.291655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53351808-025a-4a4c-841c-23bd5be6bca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.292306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53351808-025a-4a4c-841c-23bd5be6bca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.292778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-40af9f68-57fe-414b-a120-36a7ad6cbcfa None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:21.293957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53351808-025a-4a4c-841c-23bd5be6bca1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.294236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-40af9f68-57fe-414b-a120-36a7ad6cbcfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.302972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 863/1729] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:21.303959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9f68-57fe-414b-a120-36a7ad6cbcfa None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.313331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 867/1730] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:21.315284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af9f68-57fe-414b-a120-36a7ad6cbcfa None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.317098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090ec48-0eaa-4e3e-9543-780cf8cd1820 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.317393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090ec48-0eaa-4e3e-9543-780cf8cd1820 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.317670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090ec48-0eaa-4e3e-9543-780cf8cd1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.321498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f3a4-78e5-45ff-a7cc-0255c32a770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.322357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f3a4-78e5-45ff-a7cc-0255c32a770f admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.322707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f3a4-78e5-45ff-a7cc-0255c32a770f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.323032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81f3a4-78e5-45ff-a7cc-0255c32a770f admin admin] PATH_INFO: `/v3/projects/efcea8d402ae4fa993f0aa2938eb4b28/users/13893d6b85214d42a8eff0be892fd338/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.325143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81f3a4-78e5-45ff-a7cc-0255c32a770f admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcea8d402ae4fa993f0aa2938eb4b28, user_id=13893d6b85214d42a8eff0be892fd338, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.329653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb81f3a4-78e5-45ff-a7cc-0255c32a770f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.339589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b090ec48-0eaa-4e3e-9543-780cf8cd1820 None None] MFA Rules not processed for user `18061b868be44122a849e2e239b56f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:21.340972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b090ec48-0eaa-4e3e-9543-780cf8cd1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.346078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 864/1731] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:21 2022] PUT /identity/v3/projects/efcea8d402ae4fa993f0aa2938eb4b28/users/13893d6b85214d42a8eff0be892fd338/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:21.346931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f3a4-78e5-45ff-a7cc-0255c32a770f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.357980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:21.406238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 868/1732] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:21.412298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090ec48-0eaa-4e3e-9543-780cf8cd1820 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.430361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81f3a4-78e5-45ff-a7cc-0255c32a770f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.435568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01027d43-00f3-4707-9b12-e4c834da1418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.436581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01027d43-00f3-4707-9b12-e4c834da1418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.437100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01027d43-00f3-4707-9b12-e4c834da1418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.437483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01027d43-00f3-4707-9b12-e4c834da1418 admin admin] PATH_INFO: `/v3/projects/08ae24306ce5408ba4b7327eafa94d68/users/65d7d03b079e4fbb97bcab64ecf34dd3/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.439763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01027d43-00f3-4707-9b12-e4c834da1418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ae24306ce5408ba4b7327eafa94d68, user_id=65d7d03b079e4fbb97bcab64ecf34dd3, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.442560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01027d43-00f3-4707-9b12-e4c834da1418 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.454055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 865/1733] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:21 2022] PUT /identity/v3/projects/08ae24306ce5408ba4b7327eafa94d68/users/65d7d03b079e4fbb97bcab64ecf34dd3/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:21.454934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01027d43-00f3-4707-9b12-e4c834da1418 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.475995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:21.487452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090ec48-0eaa-4e3e-9543-780cf8cd1820 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.538020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01027d43-00f3-4707-9b12-e4c834da1418 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.544155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.544840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.545262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.545543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] PATH_INFO: `/v3/projects/b9d2e0f1fc994f1494094d7217208264/users/7b9ada23c3ce441a823b9fba604a46a5/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.555266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fdb42d-64ab-49d0-a398-f8cbe1d4311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.556062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb42d-64ab-49d0-a398-f8cbe1d4311d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.556685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb42d-64ab-49d0-a398-f8cbe1d4311d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.556792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fdb42d-64ab-49d0-a398-f8cbe1d4311d admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.557470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdb42d-64ab-49d0-a398-f8cbe1d4311d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:21.557877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdb42d-64ab-49d0-a398-f8cbe1d4311d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.559783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fdb42d-64ab-49d0-a398-f8cbe1d4311d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.563207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d2e0f1fc994f1494094d7217208264, user_id=7b9ada23c3ce441a823b9fba604a46a5, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.566942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.573473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 869/1734] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:21.574946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc50b8-40cc-4807-8a14-50f1c2028fbc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.575284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc50b8-40cc-4807-8a14-50f1c2028fbc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.575557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc50b8-40cc-4807-8a14-50f1c2028fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.588309 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 866/1735] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:21 2022] PUT /identity/v3/projects/b9d2e0f1fc994f1494094d7217208264/users/7b9ada23c3ce441a823b9fba604a46a5/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:21.589475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.592898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.606126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ccbc50b8-40cc-4807-8a14-50f1c2028fbc None None] MFA Rules not processed for user `13893d6b85214d42a8eff0be892fd338`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:21.607360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ccbc50b8-40cc-4807-8a14-50f1c2028fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.661380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38764d06-a608-41d1-a86c-f5de39d7e607 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.668935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72715aa-1b6c-4689-9943-8ed568a9ed7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.669571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72715aa-1b6c-4689-9943-8ed568a9ed7f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.669906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72715aa-1b6c-4689-9943-8ed568a9ed7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.670171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72715aa-1b6c-4689-9943-8ed568a9ed7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.681037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72715aa-1b6c-4689-9943-8ed568a9ed7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.685374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72715aa-1b6c-4689-9943-8ed568a9ed7f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:21.701554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 867/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:21.703115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485dbbb-1c1e-4332-83fd-dd4fccdc9a0c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.703405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485dbbb-1c1e-4332-83fd-dd4fccdc9a0c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.703669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485dbbb-1c1e-4332-83fd-dd4fccdc9a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.711299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:21.739621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 870/1737] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:21.741485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc50b8-40cc-4807-8a14-50f1c2028fbc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:21.823220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f485dbbb-1c1e-4332-83fd-dd4fccdc9a0c None None] MFA Rules not processed for user `65d7d03b079e4fbb97bcab64ecf34dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:21.824485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f485dbbb-1c1e-4332-83fd-dd4fccdc9a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:21.917036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc50b8-40cc-4807-8a14-50f1c2028fbc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:21.976324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:21.976989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:21.977272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:21.977546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:21.982548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:21.985267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:22.037432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 868/1738] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:22.039873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485dbbb-1c1e-4332-83fd-dd4fccdc9a0c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:22.067048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485dbbb-1c1e-4332-83fd-dd4fccdc9a0c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:22.087411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 871/1739] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:21 2022] POST /identity/v3/projects => generated 365 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:22.087619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:22.088308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:22.088570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:22.088840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:22.089509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:22.091239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:22.092285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:22.097776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:22.120201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 869/1740] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:22.120201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:22.123217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:22.172213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae27ea61-d33c-43a5-b619-5b4e0ad20d44 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:22.199466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:22.241417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8910984-b28f-4483-8698-2969b163a837 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:22.252022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:22.252664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:22.252946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:22.253217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:22.359099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:22.359886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:22.360168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:22.360438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] PATH_INFO: `/v3/projects/d24d821be58545808ceac85895b370aa` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:22.362453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24d821be58545808ceac85895b370aa)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:22.364565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:22.468148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:22.470009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24d821be58545808ceac85895b370aa', 'request_id': 'req-04379d09-a7a3-4a54-9a2c-088325dd3558'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:22.471570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:22.478701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24d821be58545808ceac85895b370aa', 'request_id': 'req-04379d09-a7a3-4a54-9a2c-088325dd3558'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:22.487855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24d821be58545808ceac85895b370aa', 'request_id': 'req-04379d09-a7a3-4a54-9a2c-088325dd3558'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:22.508799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] The token cache is being invalidate because project d24d821be58545808ceac85895b370aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:22.514235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:22.515464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:22.534155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 872/1742] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:22.534292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 870/1742] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:22 2022] DELETE /identity/v3/projects/d24d821be58545808ceac85895b370aa => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:22.535173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:22.535585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:22.539851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:22.544407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:22.594111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a401c6-2bfa-41fb-9645-002b1179333a service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:22.683297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:22.696173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04379d09-a7a3-4a54-9a2c-088325dd3558 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:22.717725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4d214-f871-4ce8-88b5-d0c4e7416aa6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:22.718686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d214-f871-4ce8-88b5-d0c4e7416aa6 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:22.719619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d214-f871-4ce8-88b5-d0c4e7416aa6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:22.719870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4d214-f871-4ce8-88b5-d0c4e7416aa6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:22.722543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-20c4d214-f871-4ce8-88b5-d0c4e7416aa6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:22.724700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:22.725351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:22.725670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:22.729114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:22.731345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:22.735706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:22.792222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 871/1743] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:22 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:22.797212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:22.800663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:22.816318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1f1e3-bb1c-48c8-ba05-6525bafe0600 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:22.822743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:22.823477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:22.823756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:22.824021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] PATH_INFO: `/v3/projects/b9d2e0f1fc994f1494094d7217208264/users/7b9ada23c3ce441a823b9fba604a46a5/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:22.826044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d2e0f1fc994f1494094d7217208264, user_id=7b9ada23c3ce441a823b9fba604a46a5, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:22.829153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:22.846736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4d214-f871-4ce8-88b5-d0c4e7416aa6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:22.848232 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4d214-f871-4ce8-88b5-d0c4e7416aa6 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:22.865417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 872/1744] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:22 2022] PUT /identity/v3/projects/b9d2e0f1fc994f1494094d7217208264/users/7b9ada23c3ce441a823b9fba604a46a5/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:22.867729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:22.870190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 873/1745] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:22.871667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fd06-1f1d-481d-ba6f-432fec3c4e7f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:22.871898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fd06-1f1d-481d-ba6f-432fec3c4e7f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:22.872178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259fd06-1f1d-481d-ba6f-432fec3c4e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:22.877110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:22.914098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:22.920511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e259fd06-1f1d-481d-ba6f-432fec3c4e7f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:22.921943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e259fd06-1f1d-481d-ba6f-432fec3c4e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.027069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83377232-4223-45d3-8534-e290570ac1b8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:23.039629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:23.040385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.040385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.040545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.044562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.072268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:23.077175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:23.095582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 874/1746] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:23.097001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf629-3293-4f78-8bee-17119515a833 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.097287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf629-3293-4f78-8bee-17119515a833 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.097561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf629-3293-4f78-8bee-17119515a833 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.098983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 873/1747] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:23.111304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:23.112310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 875/1748] 10.222.0.48 () {54 vars in 961 bytes} [Sat Sep 17 03:37:23 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:23.113677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a66a-7152-4eb4-816e-b51de2f10981 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.113985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a66a-7152-4eb4-816e-b51de2f10981 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.114296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088a66a-7152-4eb4-816e-b51de2f10981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.143117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0baf7-4a07-426c-8cf7-8fadf42bc4c6 service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:23.151952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:23.152955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.153431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.153950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.154821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:23.163634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:23.192705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 874/1749] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:23.196822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f088a66a-7152-4eb4-816e-b51de2f10981 None None] MFA Rules not processed for user `7b9ada23c3ce441a823b9fba604a46a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:23.198169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f088a66a-7152-4eb4-816e-b51de2f10981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.198378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:23.201999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.334736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 876/1750] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:23.337280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f86e0-108d-42a0-99d0-0e059f6061fa None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.338810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f86e0-108d-42a0-99d0-0e059f6061fa None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.339239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f86e0-108d-42a0-99d0-0e059f6061fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.355833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:23.363215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d85f86e0-108d-42a0-99d0-0e059f6061fa None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:23.366762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d85f86e0-108d-42a0-99d0-0e059f6061fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.375476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 877/1751] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:23.377049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b43dc-0c6d-473c-9534-69cc6271296e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.381955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b43dc-0c6d-473c-9534-69cc6271296e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.382333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b43dc-0c6d-473c-9534-69cc6271296e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.392895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b12161a-d019-43c0-9ebd-9ec934e28a5e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:23.404183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:23.404530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.404975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.405166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.410130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.423174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-714b43dc-0c6d-473c-9534-69cc6271296e None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:23.424418 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-714b43dc-0c6d-473c-9534-69cc6271296e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.440228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 878/1752] 10.222.0.48 () {58 vars in 1058 bytes} [Sat Sep 17 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:23.440581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b43dc-0c6d-473c-9534-69cc6271296e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:23.452921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b43dc-0c6d-473c-9534-69cc6271296e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:23.458072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f03b3c-dcf6-418c-a01a-4b220953e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:23.459217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f03b3c-dcf6-418c-a01a-4b220953e3db admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.459217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f03b3c-dcf6-418c-a01a-4b220953e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.459687 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f03b3c-dcf6-418c-a01a-4b220953e3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.460206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f03b3c-dcf6-418c-a01a-4b220953e3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:23.462222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f03b3c-dcf6-418c-a01a-4b220953e3db admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:23.481723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 879/1753] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:23.483464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220522-bd81-43c4-8ff0-cc806e802a02 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.483747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220522-bd81-43c4-8ff0-cc806e802a02 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.484018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220522-bd81-43c4-8ff0-cc806e802a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.504982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:23.506652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:23.515932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c9220522-bd81-43c4-8ff0-cc806e802a02 None None] MFA Rules not processed for user `f2f6fd1b96d44bde897fa70cfd5459f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:23.517361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 875/1754] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:23.517773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c9220522-bd81-43c4-8ff0-cc806e802a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.518528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:23.522748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:23.535683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205d339-6a48-4290-a0c4-2b5f7d3a511d service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:23.546395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafcafb-1465-43ed-92ae-81d0abdd3da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:23.548555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafcafb-1465-43ed-92ae-81d0abdd3da9 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.548842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafcafb-1465-43ed-92ae-81d0abdd3da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.549114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafcafb-1465-43ed-92ae-81d0abdd3da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.595901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafcafb-1465-43ed-92ae-81d0abdd3da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:23.601193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafcafb-1465-43ed-92ae-81d0abdd3da9 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:23.619224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 876/1755] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:23.620400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafcafb-1465-43ed-92ae-81d0abdd3da9 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:23.632706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafcafb-1465-43ed-92ae-81d0abdd3da9 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:23.642571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 880/1756] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:23.643550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9220522-bd81-43c4-8ff0-cc806e802a02 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:23.643734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:23.644765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.645042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.645305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.646134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:23.646358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:23.662585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:23.688858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 877/1757] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:23.690749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:23.704516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e139d72-9c3a-4446-b5df-8b7efc80378d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:23.710284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336aae16-3adb-480c-8e66-c08adfee8def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:23.711094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aae16-3adb-480c-8e66-c08adfee8def admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.711377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aae16-3adb-480c-8e66-c08adfee8def admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.711776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336aae16-3adb-480c-8e66-c08adfee8def admin admin] PATH_INFO: `/v3/projects/bb6b50adcbbf4dcf8ec1f45df53607eb/users/0e90ed7b32654345b7cbfb24d792266c/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.722483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9220522-bd81-43c4-8ff0-cc806e802a02 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:23.736647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336aae16-3adb-480c-8e66-c08adfee8def admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb6b50adcbbf4dcf8ec1f45df53607eb, user_id=0e90ed7b32654345b7cbfb24d792266c, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:23.741657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336aae16-3adb-480c-8e66-c08adfee8def admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:23.747087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69251e6-40f3-4cd7-8db7-c3d8c4114a1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:23.748663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69251e6-40f3-4cd7-8db7-c3d8c4114a1b service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.749477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69251e6-40f3-4cd7-8db7-c3d8c4114a1b service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.751429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69251e6-40f3-4cd7-8db7-c3d8c4114a1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.777124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:23.792566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69251e6-40f3-4cd7-8db7-c3d8c4114a1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:23.811383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 878/1758] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:23 2022] PUT /identity/v3/projects/bb6b50adcbbf4dcf8ec1f45df53607eb/users/0e90ed7b32654345b7cbfb24d792266c/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:23.812782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336aae16-3adb-480c-8e66-c08adfee8def admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:23.813214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69251e6-40f3-4cd7-8db7-c3d8c4114a1b service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:23.854045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 881/1759] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:23.859798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72ef45-03a1-41bc-abf6-3f6e1c0ec92e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:23.860079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72ef45-03a1-41bc-abf6-3f6e1c0ec92e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:23.860356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72ef45-03a1-41bc-abf6-3f6e1c0ec92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:23.961143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1c72ef45-03a1-41bc-abf6-3f6e1c0ec92e None None] MFA Rules not processed for user `0e90ed7b32654345b7cbfb24d792266c`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:23.974940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1c72ef45-03a1-41bc-abf6-3f6e1c0ec92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:24.041780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336aae16-3adb-480c-8e66-c08adfee8def admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.055725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedf29b-77ef-4469-ae9b-f197d89d5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.057950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf29b-77ef-4469-ae9b-f197d89d5079 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.059573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf29b-77ef-4469-ae9b-f197d89d5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.061265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baedf29b-77ef-4469-ae9b-f197d89d5079 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.062240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedf29b-77ef-4469-ae9b-f197d89d5079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.070169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baedf29b-77ef-4469-ae9b-f197d89d5079 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.159475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 879/1760] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:23 2022] POST /identity/v3/projects => generated 405 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:24.160126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedf29b-77ef-4469-ae9b-f197d89d5079 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.171080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 882/1761] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:24.172609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72ef45-03a1-41bc-abf6-3f6e1c0ec92e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.188107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72ef45-03a1-41bc-abf6-3f6e1c0ec92e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.300944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baedf29b-77ef-4469-ae9b-f197d89d5079 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.311620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.312563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.312676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e003495-a145-46fd-a243-ad91d1182954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.313247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.313669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.314653 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003495-a145-46fd-a243-ad91d1182954 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.316412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003495-a145-46fd-a243-ad91d1182954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.316836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e003495-a145-46fd-a243-ad91d1182954 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.318701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e003495-a145-46fd-a243-ad91d1182954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.318894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:24.323941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e003495-a145-46fd-a243-ad91d1182954 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.352393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:24.382977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 883/1762] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:24 2022] POST /identity/v3/users => generated 303 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:24.383942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e003495-a145-46fd-a243-ad91d1182954 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.398750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e003495-a145-46fd-a243-ad91d1182954 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.405262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91c01-e735-4f35-94d6-b62db44fe3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.406112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91c01-e735-4f35-94d6-b62db44fe3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.406404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91c01-e735-4f35-94d6-b62db44fe3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.406722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a91c01-e735-4f35-94d6-b62db44fe3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.407375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a91c01-e735-4f35-94d6-b62db44fe3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.409434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a91c01-e735-4f35-94d6-b62db44fe3c2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.473795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 884/1763] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:24 2022] POST /identity/v3/projects => generated 367 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:24.474105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.474105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.475785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91c01-e735-4f35-94d6-b62db44fe3c2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.485119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 880/1764] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:24.486192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.500255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62251b4a-7351-4788-a98d-b2438f59bebc service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.556121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:24.592383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4848347-fccd-4c0b-b3e5-72763b04ab77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.596203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848347-fccd-4c0b-b3e5-72763b04ab77 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.596510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848347-fccd-4c0b-b3e5-72763b04ab77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.596793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4848347-fccd-4c0b-b3e5-72763b04ab77 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.598631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4848347-fccd-4c0b-b3e5-72763b04ab77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.604522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4848347-fccd-4c0b-b3e5-72763b04ab77 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.691790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a91c01-e735-4f35-94d6-b62db44fe3c2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.699468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 881/1765] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:24 2022] POST /identity/v3/users => generated 290 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:24.710752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4848347-fccd-4c0b-b3e5-72763b04ab77 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.714396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc8663-7c0b-4272-bdaa-26d88320ad1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.715503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8663-7c0b-4272-bdaa-26d88320ad1c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.715920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8663-7c0b-4272-bdaa-26d88320ad1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.716288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc8663-7c0b-4272-bdaa-26d88320ad1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.717169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc8663-7c0b-4272-bdaa-26d88320ad1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.718979 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc8663-7c0b-4272-bdaa-26d88320ad1c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.737841 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 885/1766] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:24.738898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc8663-7c0b-4272-bdaa-26d88320ad1c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.755834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc8663-7c0b-4272-bdaa-26d88320ad1c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.758314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4848347-fccd-4c0b-b3e5-72763b04ab77 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.762544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa8413-0658-46a8-8028-c7aa62b2dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.763731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa8413-0658-46a8-8028-c7aa62b2dc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.764071 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa8413-0658-46a8-8028-c7aa62b2dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.765090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa8413-0658-46a8-8028-c7aa62b2dc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.765312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa8413-0658-46a8-8028-c7aa62b2dc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.767459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa8413-0658-46a8-8028-c7aa62b2dc04 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.783996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef2569-692f-465d-80aa-23f3b6c3a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.785285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef2569-692f-465d-80aa-23f3b6c3a4eb admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.787885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef2569-692f-465d-80aa-23f3b6c3a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.788334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ef2569-692f-465d-80aa-23f3b6c3a4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.788714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 886/1767] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:24.790614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa8413-0658-46a8-8028-c7aa62b2dc04 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.792872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef2569-692f-465d-80aa-23f3b6c3a4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.797889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ef2569-692f-465d-80aa-23f3b6c3a4eb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.825260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 882/1768] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:24.825519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa8413-0658-46a8-8028-c7aa62b2dc04 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.827054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef2569-692f-465d-80aa-23f3b6c3a4eb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:24.836823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383e62f-8366-4aa5-8628-670eb81c6c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.837583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383e62f-8366-4aa5-8628-670eb81c6c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.837865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383e62f-8366-4aa5-8628-670eb81c6c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.841838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383e62f-8366-4aa5-8628-670eb81c6c01 admin admin] PATH_INFO: `/v3/projects/3d121f5f9efb4c5999cb53c2e12dc98f/users/a5f767a06a1d45968080924f171c7dec/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.871451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ef2569-692f-465d-80aa-23f3b6c3a4eb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:24.889394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383e62f-8366-4aa5-8628-670eb81c6c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d121f5f9efb4c5999cb53c2e12dc98f, user_id=a5f767a06a1d45968080924f171c7dec, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.892930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383e62f-8366-4aa5-8628-670eb81c6c01 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.899765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7116-c482-4a05-ab8c-4223b0a27158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:24.900731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7116-c482-4a05-ab8c-4223b0a27158 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.901214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7116-c482-4a05-ab8c-4223b0a27158 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.901699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402c7116-c482-4a05-ab8c-4223b0a27158 admin admin] PATH_INFO: `/v3/projects/f2e38ca058734d35876c1bb45e5a8b1b/users/ffda4096b1a842aa861dbc7537a7c91e/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:24.968068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c7116-c482-4a05-ab8c-4223b0a27158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e38ca058734d35876c1bb45e5a8b1b, user_id=ffda4096b1a842aa861dbc7537a7c91e, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:24.973593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 887/1769] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:24 2022] PUT /identity/v3/projects/3d121f5f9efb4c5999cb53c2e12dc98f/users/a5f767a06a1d45968080924f171c7dec/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:24.979711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947344-16cc-4b26-82a6-e4e769ae241f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:24.980581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402c7116-c482-4a05-ab8c-4223b0a27158 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:24.982185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947344-16cc-4b26-82a6-e4e769ae241f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:24.982487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947344-16cc-4b26-82a6-e4e769ae241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:25.019058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 883/1770] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:24 2022] PUT /identity/v3/projects/f2e38ca058734d35876c1bb45e5a8b1b/users/ffda4096b1a842aa861dbc7537a7c91e/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:25.022520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7116-c482-4a05-ab8c-4223b0a27158 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:25.070987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e2947344-16cc-4b26-82a6-e4e769ae241f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:25.075912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e2947344-16cc-4b26-82a6-e4e769ae241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:25.190502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402c7116-c482-4a05-ab8c-4223b0a27158 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:25.208193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065d930-22ea-46a3-9ff0-88908ac54309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:25.208752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d930-22ea-46a3-9ff0-88908ac54309 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:25.209028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d930-22ea-46a3-9ff0-88908ac54309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:25.209374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065d930-22ea-46a3-9ff0-88908ac54309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:25.210056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065d930-22ea-46a3-9ff0-88908ac54309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:25.211694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065d930-22ea-46a3-9ff0-88908ac54309 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:25.238367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 884/1771] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:37:25.242125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065d930-22ea-46a3-9ff0-88908ac54309 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:25.265259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065d930-22ea-46a3-9ff0-88908ac54309 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:25.278481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfc495c-ac28-4ec3-bd9b-7089d8cca99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:25.280494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc495c-ac28-4ec3-bd9b-7089d8cca99e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:25.281006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc495c-ac28-4ec3-bd9b-7089d8cca99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:25.281506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfc495c-ac28-4ec3-bd9b-7089d8cca99e admin admin] PATH_INFO: `/v3/projects/f2e38ca058734d35876c1bb45e5a8b1b/users/ffda4096b1a842aa861dbc7537a7c91e/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:25.287171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc495c-ac28-4ec3-bd9b-7089d8cca99e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e38ca058734d35876c1bb45e5a8b1b, user_id=ffda4096b1a842aa861dbc7537a7c91e, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:25.295378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfc495c-ac28-4ec3-bd9b-7089d8cca99e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:25.331338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 888/1772] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:25.345101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2947344-16cc-4b26-82a6-e4e769ae241f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:25.349052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e2947344-16cc-4b26-82a6-e4e769ae241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:25.351579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 885/1773] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:25 2022] PUT /identity/v3/projects/f2e38ca058734d35876c1bb45e5a8b1b/users/ffda4096b1a842aa861dbc7537a7c91e/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:25.362994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da0538-71be-4481-9cdd-828edc70ac87 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:25.363529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da0538-71be-4481-9cdd-828edc70ac87 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:25.364031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da0538-71be-4481-9cdd-828edc70ac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:25.451915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:25.523276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-48da0538-71be-4481-9cdd-828edc70ac87 None None] MFA Rules not processed for user `ffda4096b1a842aa861dbc7537a7c91e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:25.524631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-48da0538-71be-4481-9cdd-828edc70ac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:25.526463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2947344-16cc-4b26-82a6-e4e769ae241f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:25.641286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28558-f9ae-4bc7-a214-ba18926919ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:25.642380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28558-f9ae-4bc7-a214-ba18926919ec service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:25.644688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28558-f9ae-4bc7-a214-ba18926919ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:25.645497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b28558-f9ae-4bc7-a214-ba18926919ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:25.772350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:25.792006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 886/1774] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:25.832539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da0538-71be-4481-9cdd-828edc70ac87 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:25.856026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28558-f9ae-4bc7-a214-ba18926919ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:25.858228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b28558-f9ae-4bc7-a214-ba18926919ec service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:25.892236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 889/1775] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:25.913085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da0538-71be-4481-9cdd-828edc70ac87 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:25.919800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f5d42c-38f4-4afc-bf19-d0583cf54023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:25.920547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d42c-38f4-4afc-bf19-d0583cf54023 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:25.920822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d42c-38f4-4afc-bf19-d0583cf54023 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:25.921148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f5d42c-38f4-4afc-bf19-d0583cf54023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:25.939933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5d42c-38f4-4afc-bf19-d0583cf54023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:25.953416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f5d42c-38f4-4afc-bf19-d0583cf54023 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:25.987692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 887/1776] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:26.347034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28558-f9ae-4bc7-a214-ba18926919ec service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:26.381739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b28558-f9ae-4bc7-a214-ba18926919ec service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:26.406769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:26.407432 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:26.407708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:26.407978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:26.529714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:26.534975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:26.561155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 890/1777] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:27.383627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594fb8-b060-4582-8bda-9b851b866c30 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:27.384556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594fb8-b060-4582-8bda-9b851b866c30 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:27.384988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86594fb8-b060-4582-8bda-9b851b866c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:27.509646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:27.511298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:27.528870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-86594fb8-b060-4582-8bda-9b851b866c30 None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:27.530919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-86594fb8-b060-4582-8bda-9b851b866c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:27.544918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e290b97-5884-4130-bc6c-68aee460c172 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:27.565319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:27.569431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:27.571932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:27.572383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] PATH_INFO: `/v3/users/d8fb50032ec14a2b926551c9c2b7f658` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:27.578864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8fb50032ec14a2b926551c9c2b7f658)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:27.584609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:27.651139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 888/1778] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:37:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:27.734428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:27.785407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364c48-f932-433c-8e62-c74bfab32d56 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:27.785697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364c48-f932-433c-8e62-c74bfab32d56 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:27.786229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8364c48-f932-433c-8e62-c74bfab32d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:27.815678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8fb50032ec14a2b926551c9c2b7f658'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:27.816815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8fb50032ec14a2b926551c9c2b7f658'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:27.840850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8fb50032ec14a2b926551c9c2b7f658'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:27.843022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f8364c48-f932-433c-8e62-c74bfab32d56 None None] MFA Rules not processed for user `a5f767a06a1d45968080924f171c7dec`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:27.845846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f8364c48-f932-433c-8e62-c74bfab32d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:27.888567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8fb50032ec14a2b926551c9c2b7f658'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:27.889798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f353d74f-cd5a-4c80-852f-28998206c7ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8fb50032ec14a2b926551c9c2b7f658'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:27.944693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 891/1779] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:27 2022] DELETE /identity/v3/users/d8fb50032ec14a2b926551c9c2b7f658 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:27.950727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68068-d34d-4163-930a-9100cd34979a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:27.951117 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68068-d34d-4163-930a-9100cd34979a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:27.951431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68068-d34d-4163-930a-9100cd34979a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:28.002370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c6d68068-d34d-4163-930a-9100cd34979a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:28.005252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c6d68068-d34d-4163-930a-9100cd34979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:28.096190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 889/1780] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:28.097348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8364c48-f932-433c-8e62-c74bfab32d56 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:28.099671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f8364c48-f932-433c-8e62-c74bfab32d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:28.101246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 892/1781] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:28.102561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68068-d34d-4163-930a-9100cd34979a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:28.105050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c6d68068-d34d-4163-930a-9100cd34979a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:28.114569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:28.125015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68068-d34d-4163-930a-9100cd34979a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:28.132649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:28.133347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:28.133683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:28.134348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:28.135156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:28.137236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:28.211483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 893/1782] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:28 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:28.214893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:28.220883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:28.343746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee5d56-195b-4e3a-b29d-3dbffbd1a8c5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:28.347744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8364c48-f932-433c-8e62-c74bfab32d56 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:28.368398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29404669-af3e-40a2-9523-5412ea52f985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:28.369998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404669-af3e-40a2-9523-5412ea52f985 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:28.372176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404669-af3e-40a2-9523-5412ea52f985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:28.372995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29404669-af3e-40a2-9523-5412ea52f985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:28.498499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:28.499239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:28.499401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:28.499832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:28.502948 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:28.530325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:28.577107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29404669-af3e-40a2-9523-5412ea52f985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:28.578681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29404669-af3e-40a2-9523-5412ea52f985 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:28.618290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 894/1783] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:28.619531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29404669-af3e-40a2-9523-5412ea52f985 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:28.670138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29404669-af3e-40a2-9523-5412ea52f985 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:28.682153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:28.687613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:28.689703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4631a-e006-4b91-9f4c-acfd7f7ac20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:28.697204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4631a-e006-4b91-9f4c-acfd7f7ac20f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:28.697857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4631a-e006-4b91-9f4c-acfd7f7ac20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:28.698300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b4631a-e006-4b91-9f4c-acfd7f7ac20f admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:28.700159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4631a-e006-4b91-9f4c-acfd7f7ac20f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:28.708829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b4631a-e006-4b91-9f4c-acfd7f7ac20f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:28.720542 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 890/1784] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:37:28.780755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 895/1785] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:28 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:28.784990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:28.808178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff3bbeb-490c-48a4-8730-2fc21fd92abf service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:28.829289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc250e3-936c-4f18-90da-f42c991c3c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:28.830021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc250e3-936c-4f18-90da-f42c991c3c38 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:28.830967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc250e3-936c-4f18-90da-f42c991c3c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:28.830967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc250e3-936c-4f18-90da-f42c991c3c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:28.831302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc250e3-936c-4f18-90da-f42c991c3c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:28.832897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc250e3-936c-4f18-90da-f42c991c3c38 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:28.877448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 891/1786] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:37:28.884428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4631a-e006-4b91-9f4c-acfd7f7ac20f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:28.907821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b4631a-e006-4b91-9f4c-acfd7f7ac20f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:28.941253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b8875-fdfd-4c75-8046-501564993596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:28.947830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b8875-fdfd-4c75-8046-501564993596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:28.948258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b8875-fdfd-4c75-8046-501564993596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:28.950064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b8875-fdfd-4c75-8046-501564993596 admin admin] PATH_INFO: `/v3/projects/5b0f965226ee497cafd87ae0e18dd20a/users/4c72bd07f86b4f8aa597f3b78d50ea10/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:29.024828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b8875-fdfd-4c75-8046-501564993596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f965226ee497cafd87ae0e18dd20a, user_id=4c72bd07f86b4f8aa597f3b78d50ea10, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:29.034371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b8875-fdfd-4c75-8046-501564993596 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:29.091944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 896/1787] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:28 2022] PUT /identity/v3/projects/5b0f965226ee497cafd87ae0e18dd20a/users/4c72bd07f86b4f8aa597f3b78d50ea10/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:29.095824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc250e3-936c-4f18-90da-f42c991c3c38 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:29.111938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc250e3-936c-4f18-90da-f42c991c3c38 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:29.184820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:29.217512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff27c-e8d3-44fd-95c5-070f72d87f6d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:29.218013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff27c-e8d3-44fd-95c5-070f72d87f6d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:29.218460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ff27c-e8d3-44fd-95c5-070f72d87f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:29.306967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-659ff27c-e8d3-44fd-95c5-070f72d87f6d None None] MFA Rules not processed for user `18061b868be44122a849e2e239b56f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:29.314763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-659ff27c-e8d3-44fd-95c5-070f72d87f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:29.470601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe2730-11ec-4f16-ad76-1c457a44b06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:29.471420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2730-11ec-4f16-ad76-1c457a44b06b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:29.471724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2730-11ec-4f16-ad76-1c457a44b06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:29.471978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fe2730-11ec-4f16-ad76-1c457a44b06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:29.472643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe2730-11ec-4f16-ad76-1c457a44b06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:29.474337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fe2730-11ec-4f16-ad76-1c457a44b06b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:29.546064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 892/1788] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:29.552976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe2730-11ec-4f16-ad76-1c457a44b06b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:29.601787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fe2730-11ec-4f16-ad76-1c457a44b06b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:29.602132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 897/1789] 10.222.0.55 () {58 vars in 1015 bytes} [Sat Sep 17 03:37:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:29.621874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:29.621874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:29.621874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:29.621874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] PATH_INFO: `/v3/projects/5b0f965226ee497cafd87ae0e18dd20a/users/4c72bd07f86b4f8aa597f3b78d50ea10/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:29.622574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b0f965226ee497cafd87ae0e18dd20a, user_id=4c72bd07f86b4f8aa597f3b78d50ea10, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:29.624922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:29.660272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 893/1790] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:29 2022] PUT /identity/v3/projects/5b0f965226ee497cafd87ae0e18dd20a/users/4c72bd07f86b4f8aa597f3b78d50ea10/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:29.833210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff27c-e8d3-44fd-95c5-070f72d87f6d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:29.854307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ff27c-e8d3-44fd-95c5-070f72d87f6d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:30.045469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb67da7-1f6a-49d2-bd9d-3e2e5c5ef6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:30.049273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb67da7-1f6a-49d2-bd9d-3e2e5c5ef6af service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:30.049809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb67da7-1f6a-49d2-bd9d-3e2e5c5ef6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:30.050406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb67da7-1f6a-49d2-bd9d-3e2e5c5ef6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:30.074110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb67da7-1f6a-49d2-bd9d-3e2e5c5ef6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:30.078992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb67da7-1f6a-49d2-bd9d-3e2e5c5ef6af service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:30.101698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 898/1791] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:30.872721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:30.874705 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:31.316952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd18f36c-9928-4416-aa46-82527e425ea6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:31.351339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:31.354751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:31.355033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:31.355310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] PATH_INFO: `/v3/projects/2edc42ba99374102bbdfbe348ee203f3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:31.363785 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edc42ba99374102bbdfbe348ee203f3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:31.366288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:31.615887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edc42ba99374102bbdfbe348ee203f3', 'request_id': 'req-835457f3-60a3-42e2-bba4-b8a1f089db4a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:31.641808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edc42ba99374102bbdfbe348ee203f3', 'request_id': 'req-835457f3-60a3-42e2-bba4-b8a1f089db4a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:31.689199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edc42ba99374102bbdfbe348ee203f3', 'request_id': 'req-835457f3-60a3-42e2-bba4-b8a1f089db4a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:31.745154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] The token cache is being invalidate because project 2edc42ba99374102bbdfbe348ee203f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:31.745623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:31.746615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:31.751907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 894/1792] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:30 2022] DELETE /identity/v3/projects/2edc42ba99374102bbdfbe348ee203f3 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:31.756197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb67da7-1f6a-49d2-bd9d-3e2e5c5ef6af service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:31.787142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb67da7-1f6a-49d2-bd9d-3e2e5c5ef6af service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:32.047311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:32.090918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:32.091584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:32.091861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:32.092132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] PATH_INFO: `/v3/users/13893d6b85214d42a8eff0be892fd338` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:32.098716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13893d6b85214d42a8eff0be892fd338)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:32.107040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:32.267306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13893d6b85214d42a8eff0be892fd338'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:32.270107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13893d6b85214d42a8eff0be892fd338'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:32.294275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13893d6b85214d42a8eff0be892fd338'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:32.334338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13893d6b85214d42a8eff0be892fd338'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:32.335543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13893d6b85214d42a8eff0be892fd338'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:32.371582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 899/1793] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:31 2022] DELETE /identity/v3/users/13893d6b85214d42a8eff0be892fd338 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:34.263766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:34.265238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:34.290243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835457f3-60a3-42e2-bba4-b8a1f089db4a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:34.406669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:34.485412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:34.489120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:34.510761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:34.511451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:34.511712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:34.511978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] PATH_INFO: `/v3/users/37a19615b22f40689b3174b7ac5da78c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:34.516219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a19615b22f40689b3174b7ac5da78c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:34.518172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:34.661113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a19615b22f40689b3174b7ac5da78c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.662110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a19615b22f40689b3174b7ac5da78c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.694292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a19615b22f40689b3174b7ac5da78c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.712503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a19615b22f40689b3174b7ac5da78c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.713249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a19615b22f40689b3174b7ac5da78c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.743230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6d4ed-1764-4ed7-8345-aa6e5c58c7f3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:34.763539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:34.764550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:34.764945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:34.765156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] PATH_INFO: `/v3/users/abd51900f99b4f70b314dbb9546cfd8a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:34.768364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd51900f99b4f70b314dbb9546cfd8a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:34.770772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 895/1794] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:34 2022] DELETE /identity/v3/users/37a19615b22f40689b3174b7ac5da78c => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:34.771532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:34.771885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:34.773427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:34.890511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd51900f99b4f70b314dbb9546cfd8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.891542 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd51900f99b4f70b314dbb9546cfd8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.906860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd51900f99b4f70b314dbb9546cfd8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.911035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3099427f-9ea4-4a10-a1b0-6d274ca9aa59 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:34.926573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:34.927651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:34.927934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:34.928251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] PATH_INFO: `/v3/users/0e90ed7b32654345b7cbfb24d792266c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:34.930729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e90ed7b32654345b7cbfb24d792266c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:34.933451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:34.946848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:34.953601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd51900f99b4f70b314dbb9546cfd8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:34.956246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5c96fa-ba03-4f2b-aef4-00ed887a767c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd51900f99b4f70b314dbb9546cfd8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:35.014555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 900/1795] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:34 2022] DELETE /identity/v3/users/abd51900f99b4f70b314dbb9546cfd8a => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:35.016506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bac1-10c6-4067-96b4-319905bb9fb6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.016944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bac1-10c6-4067-96b4-319905bb9fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.017130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916bac1-10c6-4067-96b4-319905bb9fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.048195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0916bac1-10c6-4067-96b4-319905bb9fb6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:35.049601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0916bac1-10c6-4067-96b4-319905bb9fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:35.054973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e90ed7b32654345b7cbfb24d792266c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:35.057190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e90ed7b32654345b7cbfb24d792266c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:35.063832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:35.090822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e90ed7b32654345b7cbfb24d792266c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:35.103490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e90ed7b32654345b7cbfb24d792266c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:35.104202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-de06b241-c7a7-4984-ba64-899e26397ab9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e90ed7b32654345b7cbfb24d792266c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:35.138582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 896/1796] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:34 2022] DELETE /identity/v3/users/0e90ed7b32654345b7cbfb24d792266c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:35.140256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ee91-dbc4-4521-a437-0bcdf632ac57 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.146868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ee91-dbc4-4521-a437-0bcdf632ac57 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.147379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ee91-dbc4-4521-a437-0bcdf632ac57 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.149099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 897/1797] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:37:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:35.150437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2a69-ad85-498f-8b76-a8ee05332bf6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.150892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2a69-ad85-498f-8b76-a8ee05332bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.151313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d2a69-ad85-498f-8b76-a8ee05332bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.196352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 901/1798] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:35.204186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4931c4-277a-479f-a2dd-0d00fb67e02a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.204462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4931c4-277a-479f-a2dd-0d00fb67e02a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.204742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4931c4-277a-479f-a2dd-0d00fb67e02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.217653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-db1d2a69-ad85-498f-8b76-a8ee05332bf6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:35.218946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-db1d2a69-ad85-498f-8b76-a8ee05332bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:35.241886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ec4931c4-277a-479f-a2dd-0d00fb67e02a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:35.243774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ec4931c4-277a-479f-a2dd-0d00fb67e02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:35.377806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 902/1799] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:35.378682 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58a1a-20fd-4748-b39b-567b0d81646f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.378970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58a1a-20fd-4748-b39b-567b0d81646f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.379244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c58a1a-20fd-4748-b39b-567b0d81646f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.392007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 898/1800] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:35.392007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d2a69-ad85-498f-8b76-a8ee05332bf6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:35.392007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-db1d2a69-ad85-498f-8b76-a8ee05332bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:35.435956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-90c58a1a-20fd-4748-b39b-567b0d81646f None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:35.437449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90c58a1a-20fd-4748-b39b-567b0d81646f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:35.548725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1d2a69-ad85-498f-8b76-a8ee05332bf6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:35.557708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807415d-a3a9-4509-b3ec-1c8e8f1b11d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:35.559080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807415d-a3a9-4509-b3ec-1c8e8f1b11d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.559080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807415d-a3a9-4509-b3ec-1c8e8f1b11d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.559280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807415d-a3a9-4509-b3ec-1c8e8f1b11d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.589303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807415d-a3a9-4509-b3ec-1c8e8f1b11d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:35.592740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807415d-a3a9-4509-b3ec-1c8e8f1b11d1 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:35.629940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 903/1801] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:35.631804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58a1a-20fd-4748-b39b-567b0d81646f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:35.632224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 899/1802] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:35.633139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807415d-a3a9-4509-b3ec-1c8e8f1b11d1 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:35.654574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807415d-a3a9-4509-b3ec-1c8e8f1b11d1 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:35.662399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c58a1a-20fd-4748-b39b-567b0d81646f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:35.667880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:35.669141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.669423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.669941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.671888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:35.674061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.674453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.675440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.687615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:35.690246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:35.699769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:35.701468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:35.706128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 904/1803] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:35.727347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 900/1804] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:35.762599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:35.764155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:35.790777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12b9c6-b66a-4007-a081-aa31d9038f36 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:35.791938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:35.793462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:35.797049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e6c8a-0398-490d-a70d-fc706e7a1ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:35.798024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6c8a-0398-490d-a70d-fc706e7a1ecc service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.798280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6c8a-0398-490d-a70d-fc706e7a1ecc service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.798503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e6c8a-0398-490d-a70d-fc706e7a1ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.813026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:35.818229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e6c8a-0398-490d-a70d-fc706e7a1ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:35.819734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f303f0-cccf-4c1a-9e82-962769d40a53 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:35.831826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:35.832489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:35.832837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:35.833052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e6c8a-0398-490d-a70d-fc706e7a1ecc service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:35.833248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] PATH_INFO: `/v3/projects/efcea8d402ae4fa993f0aa2938eb4b28` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:35.834506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcea8d402ae4fa993f0aa2938eb4b28)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:35.836628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:35.862000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 905/1805] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:35.960274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcea8d402ae4fa993f0aa2938eb4b28', 'request_id': 'req-6d9d9d81-3c6c-4c29-8834-3917e5c08609'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:35.966752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:35.970341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcea8d402ae4fa993f0aa2938eb4b28', 'request_id': 'req-6d9d9d81-3c6c-4c29-8834-3917e5c08609'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:35.993859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcea8d402ae4fa993f0aa2938eb4b28', 'request_id': 'req-6d9d9d81-3c6c-4c29-8834-3917e5c08609'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:36.012504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] The token cache is being invalidate because project efcea8d402ae4fa993f0aa2938eb4b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:36.012857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:36.022773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6d9d9d81-3c6c-4c29-8834-3917e5c08609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:36.024925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 901/1806] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:35 2022] DELETE /identity/v3/projects/efcea8d402ae4fa993f0aa2938eb4b28 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:36.030816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e135d-1ca0-451c-8681-6735a505bca7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:36.031222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e135d-1ca0-451c-8681-6735a505bca7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:36.031635 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e135d-1ca0-451c-8681-6735a505bca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:36.080607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4b8e135d-1ca0-451c-8681-6735a505bca7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:36.081952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4b8e135d-1ca0-451c-8681-6735a505bca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:36.244497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 906/1807] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:36.247406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153457d-3392-430e-b632-15bb763e8253 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:36.247863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153457d-3392-430e-b632-15bb763e8253 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:36.248290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153457d-3392-430e-b632-15bb763e8253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:36.305284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9153457d-3392-430e-b632-15bb763e8253 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:36.310499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9153457d-3392-430e-b632-15bb763e8253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:36.336464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 902/1808] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:36.337666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e135d-1ca0-451c-8681-6735a505bca7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:36.360206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e135d-1ca0-451c-8681-6735a505bca7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:36.366616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:36.367295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:36.367574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:36.368010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:36.369611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:36.369980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:36.371859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:36.386408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 907/1809] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:36.390581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153457d-3392-430e-b632-15bb763e8253 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:36.404978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153457d-3392-430e-b632-15bb763e8253 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:36.415530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:36.416633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:36.417005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:36.417362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:36.418338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:36.420385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:36.488137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 903/1810] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:36 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:36.489539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:36.502497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5463577-fd2a-4609-9cac-ebfd159d95cc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:36.588008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:36.591014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:36.721083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14bef0-8464-4bb0-b07f-f62d99b0c58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:36.723894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bef0-8464-4bb0-b07f-f62d99b0c58d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:36.724981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bef0-8464-4bb0-b07f-f62d99b0c58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:36.726311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14bef0-8464-4bb0-b07f-f62d99b0c58d admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:36.728095 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14bef0-8464-4bb0-b07f-f62d99b0c58d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:36.735632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14bef0-8464-4bb0-b07f-f62d99b0c58d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:36.738117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e0bb2-b9ba-4800-b415-79bcaa6d41b6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:36.753989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:36.754674 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:36.755021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:36.755303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] PATH_INFO: `/v3/projects/8adbdf078fca4620ba1f4c377aff346e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:36.762420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8adbdf078fca4620ba1f4c377aff346e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:36.764958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:36.818552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 908/1811] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:36 2022] POST /identity/v3/users => generated 291 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:36.822285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60903a-7fa9-4062-af63-42d6f66ac36e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:36.822572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60903a-7fa9-4062-af63-42d6f66ac36e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:36.822846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60903a-7fa9-4062-af63-42d6f66ac36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:36.893396 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8adbdf078fca4620ba1f4c377aff346e', 'request_id': 'req-5a8f70a6-57b3-49f4-bfd0-b7658e178667'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:36.915550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8adbdf078fca4620ba1f4c377aff346e', 'request_id': 'req-5a8f70a6-57b3-49f4-bfd0-b7658e178667'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:36.930979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8adbdf078fca4620ba1f4c377aff346e', 'request_id': 'req-5a8f70a6-57b3-49f4-bfd0-b7658e178667'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:36.932284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ec60903a-7fa9-4062-af63-42d6f66ac36e None None] MFA Rules not processed for user `4c72bd07f86b4f8aa597f3b78d50ea10`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:36.933525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ec60903a-7fa9-4062-af63-42d6f66ac36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:36.967101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] The token cache is being invalidate because project 8adbdf078fca4620ba1f4c377aff346e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:36.968879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:36.972524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:36.974998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 904/1812] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:36 2022] DELETE /identity/v3/projects/8adbdf078fca4620ba1f4c377aff346e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:36.976591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:36.985316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:37.086056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:37.095477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:37.123219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 909/1813] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:37.124112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60903a-7fa9-4062-af63-42d6f66ac36e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:37.128278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f70a6-57b3-49f4-bfd0-b7658e178667 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:37.131412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ec60903a-7fa9-4062-af63-42d6f66ac36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:37.144305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5d462-dfbd-4f26-9f49-ceddd766f40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:37.144900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d462-dfbd-4f26-9f49-ceddd766f40b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.145185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d462-dfbd-4f26-9f49-ceddd766f40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.145460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5d462-dfbd-4f26-9f49-ceddd766f40b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.146154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5d462-dfbd-4f26-9f49-ceddd766f40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:37.147822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5d462-dfbd-4f26-9f49-ceddd766f40b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:37.161717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60903a-7fa9-4062-af63-42d6f66ac36e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:37.174868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 905/1814] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:37.174868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75d77-1954-46f3-87fe-7be969da1594 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.174868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75d77-1954-46f3-87fe-7be969da1594 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.174868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b75d77-1954-46f3-87fe-7be969da1594 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.177529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:37.178363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.179251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.179251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] PATH_INFO: `/v3/users/7b9ada23c3ce441a823b9fba604a46a5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.181057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9ada23c3ce441a823b9fba604a46a5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:37.183344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:37.186166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 906/1815] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:37:37 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:37.187457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b75d77-1954-46f3-87fe-7be969da1594 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:37.215854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b75d77-1954-46f3-87fe-7be969da1594 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:37.221623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d08cc-b469-4291-ad3a-816769e8aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:37.222454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d08cc-b469-4291-ad3a-816769e8aa20 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.222640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d08cc-b469-4291-ad3a-816769e8aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.222889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d08cc-b469-4291-ad3a-816769e8aa20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.223709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d08cc-b469-4291-ad3a-816769e8aa20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:37.225542 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d08cc-b469-4291-ad3a-816769e8aa20 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:37.257856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 907/1816] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:37.259067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d08cc-b469-4291-ad3a-816769e8aa20 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:37.283556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d08cc-b469-4291-ad3a-816769e8aa20 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:37.294128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9ada23c3ce441a823b9fba604a46a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:37.296001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9ada23c3ce441a823b9fba604a46a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:37.301349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633aa3d-8893-4966-9fce-82b1a6810da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:37.302369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633aa3d-8893-4966-9fce-82b1a6810da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.302911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633aa3d-8893-4966-9fce-82b1a6810da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.303548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633aa3d-8893-4966-9fce-82b1a6810da0 admin admin] PATH_INFO: `/v3/projects/3a2aed06631842b3a3ce0c3ddb9b618d/users/ff94ed5eae67430d8efb1cb465924ae0/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.313916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9ada23c3ce441a823b9fba604a46a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:37.338680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9ada23c3ce441a823b9fba604a46a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:37.339666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca98b9ca-f978-4d73-ad19-0d2358f023a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9ada23c3ce441a823b9fba604a46a5'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:37.346869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633aa3d-8893-4966-9fce-82b1a6810da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a2aed06631842b3a3ce0c3ddb9b618d, user_id=ff94ed5eae67430d8efb1cb465924ae0, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:37.360952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633aa3d-8893-4966-9fce-82b1a6810da0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:37.365091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 910/1817] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:37 2022] DELETE /identity/v3/users/7b9ada23c3ce441a823b9fba604a46a5 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:37.366503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770affc-f8fd-431d-813a-0e10a645a365 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.367307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770affc-f8fd-431d-813a-0e10a645a365 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.367956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9770affc-f8fd-431d-813a-0e10a645a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.385376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 908/1818] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:37 2022] PUT /identity/v3/projects/3a2aed06631842b3a3ce0c3ddb9b618d/users/ff94ed5eae67430d8efb1cb465924ae0/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:37.395779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56d6b4-6013-4c49-9ecd-5956e253c51f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.396041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56d6b4-6013-4c49-9ecd-5956e253c51f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.396400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56d6b4-6013-4c49-9ecd-5956e253c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.410490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9770affc-f8fd-431d-813a-0e10a645a365 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:37.413497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9770affc-f8fd-431d-813a-0e10a645a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:37.467596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4e56d6b4-6013-4c49-9ecd-5956e253c51f None None] MFA Rules not processed for user `ff94ed5eae67430d8efb1cb465924ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:37.468903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4e56d6b4-6013-4c49-9ecd-5956e253c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:37.577488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 911/1819] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:37.607921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 909/1820] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:37.612773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770affc-f8fd-431d-813a-0e10a645a365 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:37.627755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9770affc-f8fd-431d-813a-0e10a645a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:37.737835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9770affc-f8fd-431d-813a-0e10a645a365 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:37.748902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35318d-f66a-4cbf-985b-349aa9f45a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:37.749945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35318d-f66a-4cbf-985b-349aa9f45a43 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.750398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35318d-f66a-4cbf-985b-349aa9f45a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.750845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35318d-f66a-4cbf-985b-349aa9f45a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.751843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35318d-f66a-4cbf-985b-349aa9f45a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:37.756106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35318d-f66a-4cbf-985b-349aa9f45a43 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:37.769594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:37.786712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56d6b4-6013-4c49-9ecd-5956e253c51f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:37.789587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4e56d6b4-6013-4c49-9ecd-5956e253c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:37.820362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56d6b4-6013-4c49-9ecd-5956e253c51f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:37.838361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 912/1821] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:37 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:37.838885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657746b-ced9-4a3e-bbd3-4256b2121a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:37.839532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657746b-ced9-4a3e-bbd3-4256b2121a30 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.839807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657746b-ced9-4a3e-bbd3-4256b2121a30 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.840077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3657746b-ced9-4a3e-bbd3-4256b2121a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.842640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35318d-f66a-4cbf-985b-349aa9f45a43 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:37.864426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657746b-ced9-4a3e-bbd3-4256b2121a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:37.866447 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3657746b-ced9-4a3e-bbd3-4256b2121a30 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:37.896189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 910/1822] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:37:37.949150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35318d-f66a-4cbf-985b-349aa9f45a43 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:37.955080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525697-77e2-4ef0-809c-be7af1370bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:37.956178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525697-77e2-4ef0-809c-be7af1370bd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:37.957017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525697-77e2-4ef0-809c-be7af1370bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:37.957490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be525697-77e2-4ef0-809c-be7af1370bd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:37.958854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be525697-77e2-4ef0-809c-be7af1370bd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:37.961472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be525697-77e2-4ef0-809c-be7af1370bd3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:38.008518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 913/1823] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:37 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:38.012868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657746b-ced9-4a3e-bbd3-4256b2121a30 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:38.040857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3657746b-ced9-4a3e-bbd3-4256b2121a30 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:38.047297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5aac0-93e5-4bdc-b658-43443ffb818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:38.048384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5aac0-93e5-4bdc-b658-43443ffb818d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:38.048959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5aac0-93e5-4bdc-b658-43443ffb818d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:38.049619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5aac0-93e5-4bdc-b658-43443ffb818d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:38.050593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5aac0-93e5-4bdc-b658-43443ffb818d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:38.061511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5aac0-93e5-4bdc-b658-43443ffb818d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:38.089668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 911/1824] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:38.090164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525697-77e2-4ef0-809c-be7af1370bd3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:38.108536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be525697-77e2-4ef0-809c-be7af1370bd3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:38.114894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acabae-e4ee-4ba7-b5e3-90090679688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:38.116106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acabae-e4ee-4ba7-b5e3-90090679688b admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:38.116560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acabae-e4ee-4ba7-b5e3-90090679688b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:38.117140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acabae-e4ee-4ba7-b5e3-90090679688b admin admin] PATH_INFO: `/v3/projects/0a13814a2fa54f029669b169b4e3579b/users/1b77fc4230694331a03ddb3d10191a49/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:38.140635 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acabae-e4ee-4ba7-b5e3-90090679688b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a13814a2fa54f029669b169b4e3579b, user_id=1b77fc4230694331a03ddb3d10191a49, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:38.155014 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acabae-e4ee-4ba7-b5e3-90090679688b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:38.184058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 914/1825] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:38 2022] PUT /identity/v3/projects/0a13814a2fa54f029669b169b4e3579b/users/1b77fc4230694331a03ddb3d10191a49/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:38.185769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5aac0-93e5-4bdc-b658-43443ffb818d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:38.199348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5aac0-93e5-4bdc-b658-43443ffb818d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:38.388831 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6e6aa-4778-4291-bdd7-3cbf0de99617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:38.392667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e6aa-4778-4291-bdd7-3cbf0de99617 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:38.393002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e6aa-4778-4291-bdd7-3cbf0de99617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:38.394208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6e6aa-4778-4291-bdd7-3cbf0de99617 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:38.397730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6e6aa-4778-4291-bdd7-3cbf0de99617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:38.403112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6e6aa-4778-4291-bdd7-3cbf0de99617 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:38.446868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acabae-e4ee-4ba7-b5e3-90090679688b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:38.447046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 912/1826] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:38.467368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acabae-e4ee-4ba7-b5e3-90090679688b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:38.479566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:38.480271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:38.480550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:38.480900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] PATH_INFO: `/v3/projects/0a13814a2fa54f029669b169b4e3579b/users/1b77fc4230694331a03ddb3d10191a49/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:38.484988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a13814a2fa54f029669b169b4e3579b, user_id=1b77fc4230694331a03ddb3d10191a49, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:38.491439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:38.523475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 915/1827] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:38 2022] PUT /identity/v3/projects/0a13814a2fa54f029669b169b4e3579b/users/1b77fc4230694331a03ddb3d10191a49/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:38.536935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c29b2-7915-454c-9e44-b9e95bff6c0b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:38.536935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c29b2-7915-454c-9e44-b9e95bff6c0b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:38.536935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c29b2-7915-454c-9e44-b9e95bff6c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:38.559948 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:38.594798 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-788c29b2-7915-454c-9e44-b9e95bff6c0b None None] MFA Rules not processed for user `1b77fc4230694331a03ddb3d10191a49`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:38.598610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-788c29b2-7915-454c-9e44-b9e95bff6c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:38.777391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 913/1828] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:38.788389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:38.790307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:38.964824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4473bc5-b20b-45e4-b5c0-c65bc464dc3d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:38.974721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:38.975771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:38.977343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:38.978058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:38.997056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:38.998793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:39.022630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 916/1829] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:39.180386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c29b2-7915-454c-9e44-b9e95bff6c0b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:39.192937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c29b2-7915-454c-9e44-b9e95bff6c0b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:39.199255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba8cdf-781e-4608-81d5-8585bba6b1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:39.200523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8cdf-781e-4608-81d5-8585bba6b1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:39.201237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8cdf-781e-4608-81d5-8585bba6b1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:39.201701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba8cdf-781e-4608-81d5-8585bba6b1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:39.359563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba8cdf-781e-4608-81d5-8585bba6b1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:39.367247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba8cdf-781e-4608-81d5-8585bba6b1a8 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:39.392223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 914/1830] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:37:39.399043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:39.403564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:39.437634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f155d4d-20ee-40ee-b587-b718c8d22f8f None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:39.438441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f155d4d-20ee-40ee-b587-b718c8d22f8f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:39.438888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f155d4d-20ee-40ee-b587-b718c8d22f8f None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:39.440617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 915/1831] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:37:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:39.452714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e238-3bd2-4f86-8cee-c0037610ee04 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:39.453172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e238-3bd2-4f86-8cee-c0037610ee04 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:39.453649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635e238-3bd2-4f86-8cee-c0037610ee04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:39.556940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e635e238-3bd2-4f86-8cee-c0037610ee04 None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:39.564594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e635e238-3bd2-4f86-8cee-c0037610ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:39.614467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:39.695731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d1481-9fef-4189-a429-c7cc3fe90060 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:39.713481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:39.716945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:39.717380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:39.719961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] PATH_INFO: `/v3/projects/b9d2e0f1fc994f1494094d7217208264` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:39.723220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d2e0f1fc994f1494094d7217208264)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:39.730234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:39.809101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 916/1832] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:37:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:39.810577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e238-3bd2-4f86-8cee-c0037610ee04 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:39.812536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e635e238-3bd2-4f86-8cee-c0037610ee04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:39.830696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e635e238-3bd2-4f86-8cee-c0037610ee04 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:39.853373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:39.854503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:39.855660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:39.856082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] PATH_INFO: `/v3/projects/bb6b50adcbbf4dcf8ec1f45df53607eb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:39.860470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb6b50adcbbf4dcf8ec1f45df53607eb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:39.868834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:39.873215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d2e0f1fc994f1494094d7217208264', 'request_id': 'req-a758da82-17d1-47ed-ad89-2d79fd314dda'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:39.896101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d2e0f1fc994f1494094d7217208264', 'request_id': 'req-a758da82-17d1-47ed-ad89-2d79fd314dda'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:39.916381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d2e0f1fc994f1494094d7217208264', 'request_id': 'req-a758da82-17d1-47ed-ad89-2d79fd314dda'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:39.933651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:39.935338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] The token cache is being invalidate because project b9d2e0f1fc994f1494094d7217208264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:39.935807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:39.940256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:39.943385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 917/1833] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:39 2022] DELETE /identity/v3/projects/b9d2e0f1fc994f1494094d7217208264 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:39.944439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:39.947207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:40.087289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758da82-17d1-47ed-ad89-2d79fd314dda admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:40.109813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb6b50adcbbf4dcf8ec1f45df53607eb', 'request_id': 'req-7b756200-faa5-4dc1-bfa5-fda661d71e92'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.152105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb6b50adcbbf4dcf8ec1f45df53607eb', 'request_id': 'req-7b756200-faa5-4dc1-bfa5-fda661d71e92'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.179632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb6b50adcbbf4dcf8ec1f45df53607eb', 'request_id': 'req-7b756200-faa5-4dc1-bfa5-fda661d71e92'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.207708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] The token cache is being invalidate because project bb6b50adcbbf4dcf8ec1f45df53607eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:40.209020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.210327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7b756200-faa5-4dc1-bfa5-fda661d71e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.216468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 917/1834] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:39 2022] DELETE /identity/v3/projects/bb6b50adcbbf4dcf8ec1f45df53607eb => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:40.219465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473047d-e36f-4f85-8fbd-92629973295f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:40.219755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473047d-e36f-4f85-8fbd-92629973295f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:40.221391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3473047d-e36f-4f85-8fbd-92629973295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:40.227849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:40.228206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:40.228489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:40.228749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:40.234761 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:40.264201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:40.265860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:40.282415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3473047d-e36f-4f85-8fbd-92629973295f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:40.284339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3473047d-e36f-4f85-8fbd-92629973295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:40.295381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 918/1835] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:40.296347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:40.300266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:40.315000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:40.404399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 918/1836] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:40.404399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473047d-e36f-4f85-8fbd-92629973295f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:40.404399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3473047d-e36f-4f85-8fbd-92629973295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:40.438816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3473047d-e36f-4f85-8fbd-92629973295f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:40.445294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:40.445979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:40.446237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:40.446545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] PATH_INFO: `/v3/users/ffda4096b1a842aa861dbc7537a7c91e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:40.447855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffda4096b1a842aa861dbc7537a7c91e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:40.453663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:40.474747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d9353-b644-4147-8659-e6725a28d0b8 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:40.482830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:40.483895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:40.484391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:40.484832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] PATH_INFO: `/v3/projects/bf95a6cef5bd4d0ba46261600257fdf4` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:40.487131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf95a6cef5bd4d0ba46261600257fdf4)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:40.489315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:40.544095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffda4096b1a842aa861dbc7537a7c91e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.544791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffda4096b1a842aa861dbc7537a7c91e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.571617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffda4096b1a842aa861dbc7537a7c91e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.579563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf95a6cef5bd4d0ba46261600257fdf4', 'request_id': 'req-fd154712-b069-468b-95b2-c208745fd1d4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.582155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffda4096b1a842aa861dbc7537a7c91e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.587051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffda4096b1a842aa861dbc7537a7c91e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.589835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf95a6cef5bd4d0ba46261600257fdf4', 'request_id': 'req-fd154712-b069-468b-95b2-c208745fd1d4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.602382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf95a6cef5bd4d0ba46261600257fdf4', 'request_id': 'req-fd154712-b069-468b-95b2-c208745fd1d4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.621238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] The token cache is being invalidate because project bf95a6cef5bd4d0ba46261600257fdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:40.622016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.622924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fd154712-b069-468b-95b2-c208745fd1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.625986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 919/1837] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:40 2022] DELETE /identity/v3/projects/bf95a6cef5bd4d0ba46261600257fdf4 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:40.627534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53032b82-cc9f-4bb7-8492-e4cf248d5dbe None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:40.628236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53032b82-cc9f-4bb7-8492-e4cf248d5dbe None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:40.628512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53032b82-cc9f-4bb7-8492-e4cf248d5dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:40.636052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 919/1838] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:40 2022] DELETE /identity/v3/users/ffda4096b1a842aa861dbc7537a7c91e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:40.636783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:40.641736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:40.659729 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-53032b82-cc9f-4bb7-8492-e4cf248d5dbe None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:40.661733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-53032b82-cc9f-4bb7-8492-e4cf248d5dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:40.674839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:40.735794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe331df-42a0-45fe-89a3-dbb29aec1dd6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:40.742815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:40.744882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:40.745168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:40.745789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] PATH_INFO: `/v3/users/65d7d03b079e4fbb97bcab64ecf34dd3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:40.746723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d7d03b079e4fbb97bcab64ecf34dd3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:40.748949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:40.764296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 920/1839] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:40.768910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53032b82-cc9f-4bb7-8492-e4cf248d5dbe None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:40.784081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53032b82-cc9f-4bb7-8492-e4cf248d5dbe None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:40.790976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:40.792732 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:40.793065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:40.793940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:40.795064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:40.795489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:40.797896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:40.819938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 921/1840] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:40.821683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:40.833916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acb25f-0bbe-4461-ad7c-b2b702a3fa7f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:40.838875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49330744-b309-447f-a246-83fe42c39d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:40.839487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49330744-b309-447f-a246-83fe42c39d6f admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:40.839767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49330744-b309-447f-a246-83fe42c39d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:40.840079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49330744-b309-447f-a246-83fe42c39d6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:40.840723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49330744-b309-447f-a246-83fe42c39d6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:40.843134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49330744-b309-447f-a246-83fe42c39d6f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:40.852862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d7d03b079e4fbb97bcab64ecf34dd3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.853952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d7d03b079e4fbb97bcab64ecf34dd3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.877222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:40.879210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d7d03b079e4fbb97bcab64ecf34dd3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.893944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 922/1841] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:40 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:40.897651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49330744-b309-447f-a246-83fe42c39d6f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:40.898919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d7d03b079e4fbb97bcab64ecf34dd3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.899910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d7d03b079e4fbb97bcab64ecf34dd3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:40.924023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 920/1842] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:40 2022] DELETE /identity/v3/users/65d7d03b079e4fbb97bcab64ecf34dd3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:40.974377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49330744-b309-447f-a246-83fe42c39d6f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.019038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.020743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.068200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.069189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.069189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.069398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.070060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.072074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.109266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f599f-b55d-42cc-abb9-062d7da75779 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.113481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 923/1843] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:40 2022] POST /identity/v3/users => generated 283 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:41.119581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.121635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.122764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.123037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.123301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] PATH_INFO: `/v3/users/a5f767a06a1d45968080924f171c7dec` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.125543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.128953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f767a06a1d45968080924f171c7dec)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.131689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.157787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63db13-f0b4-410d-b2d5-b383133bb4b1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.157787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.157787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.157787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.158105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.158105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.158105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.169102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 924/1844] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:41.169102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.170052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.186953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f95a13-2438-440a-a435-d14bad20fea7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.192833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.193688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.193819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.194047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] PATH_INFO: `/v3/projects/f2e38ca058734d35876c1bb45e5a8b1b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.195194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e38ca058734d35876c1bb45e5a8b1b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.197850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.256902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:41.265568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e38ca058734d35876c1bb45e5a8b1b', 'request_id': 'req-250bdf72-88fa-46be-8b79-bc85e3eff52d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.273818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e38ca058734d35876c1bb45e5a8b1b', 'request_id': 'req-250bdf72-88fa-46be-8b79-bc85e3eff52d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.274686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f767a06a1d45968080924f171c7dec'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.276583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f767a06a1d45968080924f171c7dec'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.286511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e38ca058734d35876c1bb45e5a8b1b', 'request_id': 'req-250bdf72-88fa-46be-8b79-bc85e3eff52d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.289967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f767a06a1d45968080924f171c7dec'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.300042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f767a06a1d45968080924f171c7dec'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.300667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c4a3abda-63fd-44d5-b643-f58daa220d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f767a06a1d45968080924f171c7dec'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.300883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] The token cache is being invalidate because project f2e38ca058734d35876c1bb45e5a8b1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:41.301246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.302249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.304399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 925/1845] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:41 2022] DELETE /identity/v3/projects/f2e38ca058734d35876c1bb45e5a8b1b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:41.305519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.314676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.329987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:41.341851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 921/1846] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:41 2022] DELETE /identity/v3/users/a5f767a06a1d45968080924f171c7dec => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:41.341851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22cd62-d930-473e-aecb-8d290d42eb4c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.341851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22cd62-d930-473e-aecb-8d290d42eb4c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.341851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22cd62-d930-473e-aecb-8d290d42eb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.367414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2f22cd62-d930-473e-aecb-8d290d42eb4c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:41.370197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2f22cd62-d930-473e-aecb-8d290d42eb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.457261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250bdf72-88fa-46be-8b79-bc85e3eff52d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.480582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 922/1847] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:41.481863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22cd62-d930-473e-aecb-8d290d42eb4c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.483691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2f22cd62-d930-473e-aecb-8d290d42eb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.507717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22cd62-d930-473e-aecb-8d290d42eb4c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.515210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.515869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.516135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.516757 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] PATH_INFO: `/v3/projects/08ae24306ce5408ba4b7327eafa94d68` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.518225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ae24306ce5408ba4b7327eafa94d68)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.520322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.534768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e713eaa3-8ec7-4b07-8d31-adc0c3e94024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.535394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713eaa3-8ec7-4b07-8d31-adc0c3e94024 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.535667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713eaa3-8ec7-4b07-8d31-adc0c3e94024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.535936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e713eaa3-8ec7-4b07-8d31-adc0c3e94024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.536576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713eaa3-8ec7-4b07-8d31-adc0c3e94024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.538308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e713eaa3-8ec7-4b07-8d31-adc0c3e94024 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.549808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 926/1848] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:41.551681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b8cc-8f27-4225-a334-1cc0029dbb3f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.551681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b8cc-8f27-4225-a334-1cc0029dbb3f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.551681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b8cc-8f27-4225-a334-1cc0029dbb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.585644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ae24306ce5408ba4b7327eafa94d68', 'request_id': 'req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.590191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9672b8cc-8f27-4225-a334-1cc0029dbb3f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:41.592646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9672b8cc-8f27-4225-a334-1cc0029dbb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.609131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ae24306ce5408ba4b7327eafa94d68', 'request_id': 'req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.618449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ae24306ce5408ba4b7327eafa94d68', 'request_id': 'req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.651399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] The token cache is being invalidate because project 08ae24306ce5408ba4b7327eafa94d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:41.651830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.652604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.656401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 923/1849] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:41 2022] DELETE /identity/v3/projects/08ae24306ce5408ba4b7327eafa94d68 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:41.657461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.662444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.692987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 927/1850] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:41.692987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b8cc-8f27-4225-a334-1cc0029dbb3f None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.692987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9672b8cc-8f27-4225-a334-1cc0029dbb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.712092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b8cc-8f27-4225-a334-1cc0029dbb3f None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.719417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.720434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.720918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.721392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] PATH_INFO: `/v3/projects/3d121f5f9efb4c5999cb53c2e12dc98f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.723023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d121f5f9efb4c5999cb53c2e12dc98f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.725258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.735685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:41.764443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4eb7d-2d1c-4972-83e1-eb77ed718aec admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.772126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0275d-81fe-43eb-b387-6ef592be5948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.772929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0275d-81fe-43eb-b387-6ef592be5948 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.773289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0275d-81fe-43eb-b387-6ef592be5948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.781279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0275d-81fe-43eb-b387-6ef592be5948 admin admin] PATH_INFO: `/v3/projects/9370e2ebcdc34733a0643c3f67afc18c/users/cc2e5f9b05814abfba4ab295f885522c/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.804992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0275d-81fe-43eb-b387-6ef592be5948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9370e2ebcdc34733a0643c3f67afc18c, user_id=cc2e5f9b05814abfba4ab295f885522c, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.807736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0275d-81fe-43eb-b387-6ef592be5948 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.815251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:41.819340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d121f5f9efb4c5999cb53c2e12dc98f', 'request_id': 'req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.826193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 924/1851] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:41 2022] PUT /identity/v3/projects/9370e2ebcdc34733a0643c3f67afc18c/users/cc2e5f9b05814abfba4ab295f885522c/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:41.827836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d121f5f9efb4c5999cb53c2e12dc98f', 'request_id': 'req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.831134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a588-4ca4-425e-8095-53d28726ac23 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.831420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a588-4ca4-425e-8095-53d28726ac23 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.831689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937a588-4ca4-425e-8095-53d28726ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.850649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d121f5f9efb4c5999cb53c2e12dc98f', 'request_id': 'req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.851794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8937a588-4ca4-425e-8095-53d28726ac23 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:41.853105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8937a588-4ca4-425e-8095-53d28726ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.861592 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] The token cache is being invalidate because project 3d121f5f9efb4c5999cb53c2e12dc98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:41.861916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.862549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:41.864107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 928/1852] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:41 2022] DELETE /identity/v3/projects/3d121f5f9efb4c5999cb53c2e12dc98f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:41.867809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.869083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.919287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 925/1853] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:41.921020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a459-656a-4d4d-855c-5ad8e0ec22e3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.921305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a459-656a-4d4d-855c-5ad8e0ec22e3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.921571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f785a459-656a-4d4d-855c-5ad8e0ec22e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.949788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6ff32-9872-45b0-acf4-9ed38a2d7bab admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:41.952488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f785a459-656a-4d4d-855c-5ad8e0ec22e3 None None] MFA Rules not processed for user `cc2e5f9b05814abfba4ab295f885522c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:41.953790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f785a459-656a-4d4d-855c-5ad8e0ec22e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:41.955714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:41.959104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:41.959385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:41.959652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:41.960378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:41.962052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:41.963698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:41.984118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 929/1854] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:41.990326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:41.993223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.010955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0694f-f609-4595-b7c8-d055168273a3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.016660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.017328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.017602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.018189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] PATH_INFO: `/v3/users/4c72bd07f86b4f8aa597f3b78d50ea10` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.020353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c72bd07f86b4f8aa597f3b78d50ea10)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.023336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.044442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 926/1855] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:42.044442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a696d1-94b9-4cb1-9471-cc21b5f1dbed None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.044442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a696d1-94b9-4cb1-9471-cc21b5f1dbed None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.044442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a696d1-94b9-4cb1-9471-cc21b5f1dbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.064631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-98a696d1-94b9-4cb1-9471-cc21b5f1dbed None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:42.065892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-98a696d1-94b9-4cb1-9471-cc21b5f1dbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.074965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 927/1856] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:42.075811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a696d1-94b9-4cb1-9471-cc21b5f1dbed None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.085863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c72bd07f86b4f8aa597f3b78d50ea10'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.086111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a696d1-94b9-4cb1-9471-cc21b5f1dbed None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.086764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c72bd07f86b4f8aa597f3b78d50ea10'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.090830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.091448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.091724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.091991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.092626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.094556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.102555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c72bd07f86b4f8aa597f3b78d50ea10'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.116009 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c72bd07f86b4f8aa597f3b78d50ea10'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.116715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c72bd07f86b4f8aa597f3b78d50ea10'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.125326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 928/1857] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:42.126180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.129508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 930/1858] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:41 2022] DELETE /identity/v3/users/4c72bd07f86b4f8aa597f3b78d50ea10 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:42.130552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.131930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.132639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.165536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:42.184622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:42.207025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5212d6f-42b4-4fc2-a8e9-980629b032d1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.209941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bff242-e47e-4e86-8fa9-2b79c33cb5ae admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.211856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095db0d-41e5-4118-aa19-92202be2debb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.212460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095db0d-41e5-4118-aa19-92202be2debb admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.212739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095db0d-41e5-4118-aa19-92202be2debb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.213120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095db0d-41e5-4118-aa19-92202be2debb admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.213694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095db0d-41e5-4118-aa19-92202be2debb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.214987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.215594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095db0d-41e5-4118-aa19-92202be2debb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.215755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.216079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.216263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.217138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:42.217241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.218851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.237046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 931/1859] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:42.237046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.238793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.251368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 929/1860] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/projects => generated 365 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:42.251368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095db0d-41e5-4118-aa19-92202be2debb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.257142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac70f4-213e-49a4-8885-ffaa3e64134a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.320389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095db0d-41e5-4118-aa19-92202be2debb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.321642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff252eae-2d17-4b44-91a0-dd7d36187b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.322321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff252eae-2d17-4b44-91a0-dd7d36187b9c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.322565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff252eae-2d17-4b44-91a0-dd7d36187b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.322830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff252eae-2d17-4b44-91a0-dd7d36187b9c admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.323468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff252eae-2d17-4b44-91a0-dd7d36187b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.325391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff252eae-2d17-4b44-91a0-dd7d36187b9c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.325744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.326406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.326682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.326953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.327773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.329694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.351413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 932/1861] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:42.352489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff252eae-2d17-4b44-91a0-dd7d36187b9c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.363452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff252eae-2d17-4b44-91a0-dd7d36187b9c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.368051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 930/1862] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:42.368262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be078c31-33db-40e3-a56a-7fe2ff528207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.369028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078c31-33db-40e3-a56a-7fe2ff528207 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.369297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.369400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078c31-33db-40e3-a56a-7fe2ff528207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.369704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be078c31-33db-40e3-a56a-7fe2ff528207 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.370387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be078c31-33db-40e3-a56a-7fe2ff528207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.372223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.372488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be078c31-33db-40e3-a56a-7fe2ff528207 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.394256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 933/1863] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:42.395185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be078c31-33db-40e3-a56a-7fe2ff528207 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.407504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be078c31-33db-40e3-a56a-7fe2ff528207 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.445167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e42a-6705-446d-8ea7-d56d9eed7d14 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.450030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.450672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.450949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.451220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] PATH_INFO: `/v3/projects/5b0f965226ee497cafd87ae0e18dd20a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.452343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b0f965226ee497cafd87ae0e18dd20a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.454330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.467097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4263-2cd4-40c0-913b-02518b9ef53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.467704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4263-2cd4-40c0-913b-02518b9ef53b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.467977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4263-2cd4-40c0-913b-02518b9ef53b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.468243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee4263-2cd4-40c0-913b-02518b9ef53b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.468878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee4263-2cd4-40c0-913b-02518b9ef53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.470491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aee4263-2cd4-40c0-913b-02518b9ef53b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.480591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 934/1864] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:42.481608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4263-2cd4-40c0-913b-02518b9ef53b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.491817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee4263-2cd4-40c0-913b-02518b9ef53b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.499965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:42.506924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b0f965226ee497cafd87ae0e18dd20a', 'request_id': 'req-a2c0825f-2971-4367-b356-d22d3b536e2b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.516083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b0f965226ee497cafd87ae0e18dd20a', 'request_id': 'req-a2c0825f-2971-4367-b356-d22d3b536e2b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.524384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b0f965226ee497cafd87ae0e18dd20a', 'request_id': 'req-a2c0825f-2971-4367-b356-d22d3b536e2b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.534901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:42.539855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] The token cache is being invalidate because project 5b0f965226ee497cafd87ae0e18dd20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:42.540158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.540823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.542604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 931/1865] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:42 2022] DELETE /identity/v3/projects/5b0f965226ee497cafd87ae0e18dd20a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:42.543249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.544619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.552846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.553459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.553778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.554202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.554877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.556806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.578758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 935/1866] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:42.579597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.581310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.592872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d09f9-d4ad-4f24-8943-59e59eb67991 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.597619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.598270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.598553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.598814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.599445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.601081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.608288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c0825f-2971-4367-b356-d22d3b536e2b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.615307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 936/1867] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:42.615307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.615497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe29e76-36d7-49a9-851c-fa48479e6a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.615497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29e76-36d7-49a9-851c-fa48479e6a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.615497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29e76-36d7-49a9-851c-fa48479e6a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.615497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe29e76-36d7-49a9-851c-fa48479e6a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.615782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.615880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe29e76-36d7-49a9-851c-fa48479e6a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.616724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe29e76-36d7-49a9-851c-fa48479e6a52 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.627047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bd89c-acbe-4274-ba7c-b5a67374ee6c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.629596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 932/1868] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:42.630940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc76ff-f3ec-4970-86e5-837cd5aa708b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.631217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc76ff-f3ec-4970-86e5-837cd5aa708b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.631495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc76ff-f3ec-4970-86e5-837cd5aa708b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.632341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.633007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.633284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.633616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] PATH_INFO: `/v3/users/ff94ed5eae67430d8efb1cb465924ae0` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.634779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff94ed5eae67430d8efb1cb465924ae0)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.636727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.651221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-38bc76ff-f3ec-4970-86e5-837cd5aa708b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:42.652557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-38bc76ff-f3ec-4970-86e5-837cd5aa708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.660451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 933/1869] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:42.667125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc76ff-f3ec-4970-86e5-837cd5aa708b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.667125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-38bc76ff-f3ec-4970-86e5-837cd5aa708b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.674462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc76ff-f3ec-4970-86e5-837cd5aa708b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.679413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482cde-dd6c-467a-bd95-f897d56d45b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.680280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482cde-dd6c-467a-bd95-f897d56d45b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.680552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482cde-dd6c-467a-bd95-f897d56d45b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.680956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09482cde-dd6c-467a-bd95-f897d56d45b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.681585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09482cde-dd6c-467a-bd95-f897d56d45b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.683380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09482cde-dd6c-467a-bd95-f897d56d45b6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.688026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff94ed5eae67430d8efb1cb465924ae0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.688704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff94ed5eae67430d8efb1cb465924ae0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.697144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 934/1870] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:42.697144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482cde-dd6c-467a-bd95-f897d56d45b6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.697384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff94ed5eae67430d8efb1cb465924ae0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.704655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09482cde-dd6c-467a-bd95-f897d56d45b6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.708680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff94ed5eae67430d8efb1cb465924ae0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.709201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e7a5e-c89c-4ada-9f48-bf7bfe88d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.709316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff94ed5eae67430d8efb1cb465924ae0'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:42.709990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e7a5e-c89c-4ada-9f48-bf7bfe88d46e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.710270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e7a5e-c89c-4ada-9f48-bf7bfe88d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.710547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e7a5e-c89c-4ada-9f48-bf7bfe88d46e admin admin] PATH_INFO: `/v3/projects/11bb00e05653481eb6e9c3f89aba8d3e/users/5bf93de5f1434efdafda0de181cba6a7/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.725150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 937/1871] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:42 2022] DELETE /identity/v3/users/ff94ed5eae67430d8efb1cb465924ae0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:42.725150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.725150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.725616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e7a5e-c89c-4ada-9f48-bf7bfe88d46e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11bb00e05653481eb6e9c3f89aba8d3e, user_id=5bf93de5f1434efdafda0de181cba6a7, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.728419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e7a5e-c89c-4ada-9f48-bf7bfe88d46e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.742712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 935/1872] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:42 2022] PUT /identity/v3/projects/11bb00e05653481eb6e9c3f89aba8d3e/users/5bf93de5f1434efdafda0de181cba6a7/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:42.745192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236ce4c-5b33-4294-8a7c-35b91279183d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.745622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236ce4c-5b33-4294-8a7c-35b91279183d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.746062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236ce4c-5b33-4294-8a7c-35b91279183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.776318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3236ce4c-5b33-4294-8a7c-35b91279183d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:42.778046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3236ce4c-5b33-4294-8a7c-35b91279183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.799771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81e084-01b7-470c-91e1-49c8a21e6020 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.864650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:42.871328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 936/1873] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:42.875779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236ce4c-5b33-4294-8a7c-35b91279183d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:42.877219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3236ce4c-5b33-4294-8a7c-35b91279183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.891761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236ce4c-5b33-4294-8a7c-35b91279183d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:42.898775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b71c4-8f56-4764-a539-4468cd3d134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.899521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b71c4-8f56-4764-a539-4468cd3d134b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.899812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b71c4-8f56-4764-a539-4468cd3d134b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.900082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b71c4-8f56-4764-a539-4468cd3d134b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.900737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b71c4-8f56-4764-a539-4468cd3d134b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.903244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3b71c4-8f56-4764-a539-4468cd3d134b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.904160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6db6ba-4210-41c3-944f-625838d41a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:42.905305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db6ba-4210-41c3-944f-625838d41a5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.905867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db6ba-4210-41c3-944f-625838d41a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.906321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6db6ba-4210-41c3-944f-625838d41a5a admin admin] PATH_INFO: `/v3/projects/6022ed0116e1417fb5cd75624bb0101e/users/308234da979742c0b7dd0b06699da9de/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.917076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 937/1874] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:42.918435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a017ee-945d-4452-999b-e8e76ffb71ac None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.918797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a017ee-945d-4452-999b-e8e76ffb71ac None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.919139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a017ee-945d-4452-999b-e8e76ffb71ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.925804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6db6ba-4210-41c3-944f-625838d41a5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6022ed0116e1417fb5cd75624bb0101e, user_id=308234da979742c0b7dd0b06699da9de, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:42.929398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6db6ba-4210-41c3-944f-625838d41a5a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:42.941795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-76a017ee-945d-4452-999b-e8e76ffb71ac None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:42.943938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-76a017ee-945d-4452-999b-e8e76ffb71ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:42.949708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 938/1875] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:42 2022] PUT /identity/v3/projects/6022ed0116e1417fb5cd75624bb0101e/users/308234da979742c0b7dd0b06699da9de/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:42.951481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759daf9a-9529-49a6-a46b-3c7f91d18070 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:42.952045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759daf9a-9529-49a6-a46b-3c7f91d18070 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:42.952045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759daf9a-9529-49a6-a46b-3c7f91d18070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:42.959946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:42.997357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-759daf9a-9529-49a6-a46b-3c7f91d18070 None None] MFA Rules not processed for user `5bf93de5f1434efdafda0de181cba6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:42.998751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-759daf9a-9529-49a6-a46b-3c7f91d18070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:43.049253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 938/1876] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:43.051209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a017ee-945d-4452-999b-e8e76ffb71ac None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.064007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a017ee-945d-4452-999b-e8e76ffb71ac None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.071817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.072738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.073303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.073807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.074744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:43.075672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.078007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.082675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 939/1877] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:43.083441 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759daf9a-9529-49a6-a46b-3c7f91d18070 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.098449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759daf9a-9529-49a6-a46b-3c7f91d18070 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.098624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 939/1878] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:43.099139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.103201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96f363-77a4-41ec-a02b-6de04e226137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.104308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f363-77a4-41ec-a02b-6de04e226137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.104808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f363-77a4-41ec-a02b-6de04e226137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.105376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96f363-77a4-41ec-a02b-6de04e226137 admin admin] PATH_INFO: `/v3/projects/77a98bb060b94d918db3fd542f198da7/users/713c85f4661649e2801f263e4df2fccc/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.112836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cbb5c7-5246-441b-adb1-2df3bd403f91 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.121826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.122471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.123459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.123745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.124429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.126069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.128999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96f363-77a4-41ec-a02b-6de04e226137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a98bb060b94d918db3fd542f198da7, user_id=713c85f4661649e2801f263e4df2fccc, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.133950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96f363-77a4-41ec-a02b-6de04e226137 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.138160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 940/1879] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:43.139689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.141564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:43.162676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 940/1880] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:43 2022] PUT /identity/v3/projects/77a98bb060b94d918db3fd542f198da7/users/713c85f4661649e2801f263e4df2fccc/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:43.162905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd1f00-733b-434f-b501-6f6c1ce12a94 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.162990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96f363-77a4-41ec-a02b-6de04e226137 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.225063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.226107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.226534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.227179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.228284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.230581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.248593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96f363-77a4-41ec-a02b-6de04e226137 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.255087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6ce97-7661-4a39-b0c0-32b9877f6d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.256120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ce97-7661-4a39-b0c0-32b9877f6d45 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.256469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ce97-7661-4a39-b0c0-32b9877f6d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.256994 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e6ce97-7661-4a39-b0c0-32b9877f6d45 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.258083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6ce97-7661-4a39-b0c0-32b9877f6d45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.260829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e6ce97-7661-4a39-b0c0-32b9877f6d45 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.304164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 941/1881] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:43.304164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.304164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:43.306494 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 941/1882] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:43 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:43.311529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6ce97-7661-4a39-b0c0-32b9877f6d45 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.329498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:43.381792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1646833-cc81-415d-9293-88e45d294d18 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.385627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e6ce97-7661-4a39-b0c0-32b9877f6d45 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.391465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e3251-a92f-45cb-873a-a63f06af285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.392396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3251-a92f-45cb-873a-a63f06af285a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.392693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3251-a92f-45cb-873a-a63f06af285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.392969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e3251-a92f-45cb-873a-a63f06af285a admin admin] PATH_INFO: `/v3/projects/6022ed0116e1417fb5cd75624bb0101e/users/308234da979742c0b7dd0b06699da9de/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.394935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e3251-a92f-45cb-873a-a63f06af285a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6022ed0116e1417fb5cd75624bb0101e, user_id=308234da979742c0b7dd0b06699da9de, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.397641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e3251-a92f-45cb-873a-a63f06af285a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.417574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 942/1883] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:43 2022] PUT /identity/v3/projects/6022ed0116e1417fb5cd75624bb0101e/users/308234da979742c0b7dd0b06699da9de/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:43.417574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a3fd-7101-419b-ba1e-d46bad21cb63 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.417574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a3fd-7101-419b-ba1e-d46bad21cb63 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.417574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a402a3fd-7101-419b-ba1e-d46bad21cb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.418799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:43.437435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ca14a-ed0f-4159-8ff9-14bf366ff010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.438190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca14a-ed0f-4159-8ff9-14bf366ff010 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.438531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca14a-ed0f-4159-8ff9-14bf366ff010 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.439014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ca14a-ed0f-4159-8ff9-14bf366ff010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.442328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a402a3fd-7101-419b-ba1e-d46bad21cb63 None None] MFA Rules not processed for user `713c85f4661649e2801f263e4df2fccc`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:43.444077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a402a3fd-7101-419b-ba1e-d46bad21cb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:43.451147 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ca14a-ed0f-4159-8ff9-14bf366ff010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.452725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ca14a-ed0f-4159-8ff9-14bf366ff010 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.463507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 942/1884] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:43.464340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ca14a-ed0f-4159-8ff9-14bf366ff010 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.474172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ca14a-ed0f-4159-8ff9-14bf366ff010 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.545579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 943/1885] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:43.549469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402a3fd-7101-419b-ba1e-d46bad21cb63 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.559000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41993c-a06b-48ae-b075-fa9508e3d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.559885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41993c-a06b-48ae-b075-fa9508e3d592 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.560223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41993c-a06b-48ae-b075-fa9508e3d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.560529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41993c-a06b-48ae-b075-fa9508e3d592 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.561432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41993c-a06b-48ae-b075-fa9508e3d592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.564077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41993c-a06b-48ae-b075-fa9508e3d592 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.593495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 943/1886] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:43 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:43.595268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646fe61-54e3-4cf8-bbd8-9e8e883ccdf5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.595846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646fe61-54e3-4cf8-bbd8-9e8e883ccdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.595846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1646fe61-54e3-4cf8-bbd8-9e8e883ccdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.627241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1646fe61-54e3-4cf8-bbd8-9e8e883ccdf5 None None] MFA Rules not processed for user `308234da979742c0b7dd0b06699da9de`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:43.629392 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1646fe61-54e3-4cf8-bbd8-9e8e883ccdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:43.634079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a402a3fd-7101-419b-ba1e-d46bad21cb63 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.639384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b764-511d-4b9e-a1d6-ca52fd64b2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.640012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b764-511d-4b9e-a1d6-ca52fd64b2dc admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.640426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b764-511d-4b9e-a1d6-ca52fd64b2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.640535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562b764-511d-4b9e-a1d6-ca52fd64b2dc admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.641187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562b764-511d-4b9e-a1d6-ca52fd64b2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.643271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562b764-511d-4b9e-a1d6-ca52fd64b2dc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.667382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 944/1887] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:43 2022] POST /identity/v3/users => generated 284 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:43.671581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b764-511d-4b9e-a1d6-ca52fd64b2dc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.682085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562b764-511d-4b9e-a1d6-ca52fd64b2dc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.686810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476d49f-2764-477c-b546-fcd29c399722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.687421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d49f-2764-477c-b546-fcd29c399722 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.687697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d49f-2764-477c-b546-fcd29c399722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.687971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476d49f-2764-477c-b546-fcd29c399722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.688621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476d49f-2764-477c-b546-fcd29c399722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.690576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476d49f-2764-477c-b546-fcd29c399722 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.708502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 944/1888] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:43.709266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646fe61-54e3-4cf8-bbd8-9e8e883ccdf5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.723345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1646fe61-54e3-4cf8-bbd8-9e8e883ccdf5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.728618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.729236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.729520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.729829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.730474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.731493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 945/1889] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:43 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:43.732095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.732427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476d49f-2764-477c-b546-fcd29c399722 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.739249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:43.743232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 945/1890] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:43.744044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.745994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:43.808478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:43.809486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476d49f-2764-477c-b546-fcd29c399722 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.814822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3c2fd-9804-4f68-abde-6ff4a5909fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.815442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c2fd-9804-4f68-abde-6ff4a5909fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.815723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c2fd-9804-4f68-abde-6ff4a5909fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.815995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea3c2fd-9804-4f68-abde-6ff4a5909fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.816643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3c2fd-9804-4f68-abde-6ff4a5909fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.818302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea3c2fd-9804-4f68-abde-6ff4a5909fa1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.825903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cc1eb-a02a-4649-95c7-a44759deb7df admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.828424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 946/1891] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:43.829300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3c2fd-9804-4f68-abde-6ff4a5909fa1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.839006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea3c2fd-9804-4f68-abde-6ff4a5909fa1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.843767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359a1f-7964-4191-be58-4ffead4e1551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.844630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359a1f-7964-4191-be58-4ffead4e1551 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.845286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359a1f-7964-4191-be58-4ffead4e1551 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.845557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a359a1f-7964-4191-be58-4ffead4e1551 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.846255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359a1f-7964-4191-be58-4ffead4e1551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.848176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a359a1f-7964-4191-be58-4ffead4e1551 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.871689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 947/1892] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:43 2022] POST /identity/v3/users => generated 295 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:43.872516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359a1f-7964-4191-be58-4ffead4e1551 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.879431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aaefa-7391-4afd-8fc2-3dcd5546bf1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.880134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aaefa-7391-4afd-8fc2-3dcd5546bf1a service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.880484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aaefa-7391-4afd-8fc2-3dcd5546bf1a service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.880824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60aaefa-7391-4afd-8fc2-3dcd5546bf1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.882650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a359a1f-7964-4191-be58-4ffead4e1551 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:43.887455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:43.887824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:43.888099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:43.888363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] PATH_INFO: `/v3/projects/c05ce152000a47b384b1fc61098ddb98/users/500ac936b5954180856d425cb63821d3/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:43.902956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05ce152000a47b384b1fc61098ddb98, user_id=500ac936b5954180856d425cb63821d3, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.905591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.919964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 948/1893] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:43 2022] PUT /identity/v3/projects/c05ce152000a47b384b1fc61098ddb98/users/500ac936b5954180856d425cb63821d3/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:43.920773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.922345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:43.945721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aaefa-7391-4afd-8fc2-3dcd5546bf1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:43.947209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60aaefa-7391-4afd-8fc2-3dcd5546bf1a service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:43.956771 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 946/1894] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:43.957593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aaefa-7391-4afd-8fc2-3dcd5546bf1a service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:43.971960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60aaefa-7391-4afd-8fc2-3dcd5546bf1a service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.007974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b90dc8-15ac-4aea-8d8d-ac0f262a276d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.013284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.013984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.014262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.014535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] PATH_INFO: `/v3/projects/3a2aed06631842b3a3ce0c3ddb9b618d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.015690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a2aed06631842b3a3ce0c3ddb9b618d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.017615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.065413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcece9c-18ad-42eb-b859-aaaaea417345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.065763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcece9c-18ad-42eb-b859-aaaaea417345 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.066031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcece9c-18ad-42eb-b859-aaaaea417345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.066340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcece9c-18ad-42eb-b859-aaaaea417345 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.067117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcece9c-18ad-42eb-b859-aaaaea417345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.068793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcece9c-18ad-42eb-b859-aaaaea417345 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.087336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 947/1895] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:44.087336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcece9c-18ad-42eb-b859-aaaaea417345 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.098827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcece9c-18ad-42eb-b859-aaaaea417345 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.105866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a2aed06631842b3a3ce0c3ddb9b618d', 'request_id': 'req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.115492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a2aed06631842b3a3ce0c3ddb9b618d', 'request_id': 'req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.127889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a2aed06631842b3a3ce0c3ddb9b618d', 'request_id': 'req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.130096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:44.144212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:44.145181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] The token cache is being invalidate because project 3a2aed06631842b3a3ce0c3ddb9b618d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:44.146004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.147806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.150520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 949/1896] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:43 2022] DELETE /identity/v3/projects/3a2aed06631842b3a3ce0c3ddb9b618d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:44.151653 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.155048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.174592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.175862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.176554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.176849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.177558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.179972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.198493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 948/1897] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:44.199595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.201557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.232501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f5902-f3fa-4fcd-ba5d-00b52a71dd5f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.243919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.244575 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.244855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.245120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.245819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.247459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.260190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 950/1898] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:44.261287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.263138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.263856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d89c2-af31-4090-b86d-bb0248c297f6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.268070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.268896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.269350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.269915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.271975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.277710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236d674-aef8-4023-82c1-ec82c44dc5e1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.286209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.286890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.287167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.287440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] PATH_INFO: `/v3/projects/96e6ca6beb3248ec875e80fed9dcc8d3/users/f2065de0d82c4ecd925bc002fd22e053/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.313188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e6ca6beb3248ec875e80fed9dcc8d3, user_id=f2065de0d82c4ecd925bc002fd22e053, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.316832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.344263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 951/1899] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:44 2022] PUT /identity/v3/projects/96e6ca6beb3248ec875e80fed9dcc8d3/users/f2065de0d82c4ecd925bc002fd22e053/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:44.355122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.359372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.364907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.365612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.378644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 949/1900] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:44.380092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.381350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.401090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebdf0c9-88f1-40c6-9c38-1d78f727e649 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.482953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3d27c6-e131-4390-873f-630c5ae58f42 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.493986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.499562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.501196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.501491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] PATH_INFO: `/v3/users/1b77fc4230694331a03ddb3d10191a49` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.504158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664965-8913-4888-82eb-958de24b68ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.505330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664965-8913-4888-82eb-958de24b68ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.505449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b77fc4230694331a03ddb3d10191a49)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.505564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664965-8913-4888-82eb-958de24b68ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.505938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41664965-8913-4888-82eb-958de24b68ca admin admin] PATH_INFO: `/v3/projects/d60eeff681dc4a85bb2318d5a6b60020/users/19732441289c4788b87b2329fc495de4/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.509706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.526484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664965-8913-4888-82eb-958de24b68ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60eeff681dc4a85bb2318d5a6b60020, user_id=19732441289c4788b87b2329fc495de4, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.529975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41664965-8913-4888-82eb-958de24b68ca admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.551498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 950/1901] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:44 2022] PUT /identity/v3/projects/d60eeff681dc4a85bb2318d5a6b60020/users/19732441289c4788b87b2329fc495de4/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:44.552766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664965-8913-4888-82eb-958de24b68ca admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.597577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:44.604726 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b77fc4230694331a03ddb3d10191a49'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.605553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b77fc4230694331a03ddb3d10191a49'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.629980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b77fc4230694331a03ddb3d10191a49'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.668406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:44.685044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b77fc4230694331a03ddb3d10191a49'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.685044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0efb3f82-6f38-41a0-ba34-212864a21103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b77fc4230694331a03ddb3d10191a49'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:44.707971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 952/1902] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:44 2022] DELETE /identity/v3/users/1b77fc4230694331a03ddb3d10191a49 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:44.710047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72a4f-244b-4434-a1e7-699ed66deeed None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.710543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72a4f-244b-4434-a1e7-699ed66deeed None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.711241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee72a4f-244b-4434-a1e7-699ed66deeed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.749574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41664965-8913-4888-82eb-958de24b68ca admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:44.794413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2ee72a4f-244b-4434-a1e7-699ed66deeed None None] MFA Rules not processed for user `f2065de0d82c4ecd925bc002fd22e053`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:44.798666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2ee72a4f-244b-4434-a1e7-699ed66deeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.896907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:44.897664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:44.898390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:44.899049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] PATH_INFO: `/v3/projects/c05ce152000a47b384b1fc61098ddb98/users/500ac936b5954180856d425cb63821d3/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:44.906236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05ce152000a47b384b1fc61098ddb98, user_id=500ac936b5954180856d425cb63821d3, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:44.912165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:44.941519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 953/1903] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:44.942466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee72a4f-244b-4434-a1e7-699ed66deeed None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.944222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2ee72a4f-244b-4434-a1e7-699ed66deeed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.957231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 951/1904] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:44 2022] PUT /identity/v3/projects/c05ce152000a47b384b1fc61098ddb98/users/500ac936b5954180856d425cb63821d3/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:44.967128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:44.967128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:44.967390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee72a4f-244b-4434-a1e7-699ed66deeed None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.049038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8527e-2615-4bb1-a5f4-0e3d1c03a6a4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.052799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca42ed9c-936a-4230-ad3d-fd79a43cb7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.053673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ed9c-936a-4230-ad3d-fd79a43cb7de admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.054077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ed9c-936a-4230-ad3d-fd79a43cb7de admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.054514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca42ed9c-936a-4230-ad3d-fd79a43cb7de admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.055477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ed9c-936a-4230-ad3d-fd79a43cb7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.056543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612357b1-da34-4945-979f-5f2618f7e423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.057368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca42ed9c-936a-4230-ad3d-fd79a43cb7de admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.057649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612357b1-da34-4945-979f-5f2618f7e423 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.058200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612357b1-da34-4945-979f-5f2618f7e423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.058670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612357b1-da34-4945-979f-5f2618f7e423 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.059655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612357b1-da34-4945-979f-5f2618f7e423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.062607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612357b1-da34-4945-979f-5f2618f7e423 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.074940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 954/1905] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:45.076921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa101-221d-4642-9ef4-8746814490c2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.077381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa101-221d-4642-9ef4-8746814490c2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.077982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaefa101-221d-4642-9ef4-8746814490c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.100991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 952/1906] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:44 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:45.102302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612357b1-da34-4945-979f-5f2618f7e423 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.116878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-aaefa101-221d-4642-9ef4-8746814490c2 None None] MFA Rules not processed for user `500ac936b5954180856d425cb63821d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:45.118473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aaefa101-221d-4642-9ef4-8746814490c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.165737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:45.194917 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:45.197808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612357b1-da34-4945-979f-5f2618f7e423 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.204398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25d820-5ff5-4283-bbc5-fca80edb5dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.205380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d820-5ff5-4283-bbc5-fca80edb5dab admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.205709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d820-5ff5-4283-bbc5-fca80edb5dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.206016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c25d820-5ff5-4283-bbc5-fca80edb5dab admin admin] PATH_INFO: `/v3/projects/d60eeff681dc4a85bb2318d5a6b60020/users/19732441289c4788b87b2329fc495de4/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.207970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25d820-5ff5-4283-bbc5-fca80edb5dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60eeff681dc4a85bb2318d5a6b60020, user_id=19732441289c4788b87b2329fc495de4, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.210780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c25d820-5ff5-4283-bbc5-fca80edb5dab admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.222715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 953/1907] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:45 2022] PUT /identity/v3/projects/d60eeff681dc4a85bb2318d5a6b60020/users/19732441289c4788b87b2329fc495de4/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:45.223419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25d820-5ff5-4283-bbc5-fca80edb5dab admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.246022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 955/1908] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:45.247675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9473c17-9f01-445f-ba36-f00f8023b554 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.248112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9473c17-9f01-445f-ba36-f00f8023b554 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.248390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9473c17-9f01-445f-ba36-f00f8023b554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.288585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d9473c17-9f01-445f-ba36-f00f8023b554 None None] MFA Rules not processed for user `19732441289c4788b87b2329fc495de4`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:45.290149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d9473c17-9f01-445f-ba36-f00f8023b554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.316614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c25d820-5ff5-4283-bbc5-fca80edb5dab admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.322481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.323284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.324015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.324295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.324949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.326927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.364919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 954/1909] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:45 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:45.368876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.373965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.382734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 956/1910] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:45.382734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9473c17-9f01-445f-ba36-f00f8023b554 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.402861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9473c17-9f01-445f-ba36-f00f8023b554 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.408101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.408915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.409198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.409467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.410237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.411890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.427864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 957/1911] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:45.428331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.430419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.443716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044f81-3e8b-437a-ab90-172ebf1ef994 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.448698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.449335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.449611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.449910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] PATH_INFO: `/v3/projects/0a13814a2fa54f029669b169b4e3579b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.451026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a13814a2fa54f029669b169b4e3579b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.451196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a97d4-6eb1-4479-8af3-1372c43b2a1a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.452922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.455020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a0cf-c5bd-49b7-bd2b-9cadafbb9d2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.455628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a0cf-c5bd-49b7-bd2b-9cadafbb9d2d service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.455898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a0cf-c5bd-49b7-bd2b-9cadafbb9d2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.456161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a0cf-c5bd-49b7-bd2b-9cadafbb9d2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.505091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a13814a2fa54f029669b169b4e3579b', 'request_id': 'req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:45.511646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a13814a2fa54f029669b169b4e3579b', 'request_id': 'req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:45.519747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a13814a2fa54f029669b169b4e3579b', 'request_id': 'req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:45.527168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603a0cf-c5bd-49b7-bd2b-9cadafbb9d2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.528623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603a0cf-c5bd-49b7-bd2b-9cadafbb9d2d service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.530122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] The token cache is being invalidate because project 0a13814a2fa54f029669b169b4e3579b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:45.530403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:45.531029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:45.532526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 958/1912] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:45 2022] DELETE /identity/v3/projects/0a13814a2fa54f029669b169b4e3579b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:45.533288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.534574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.538442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 955/1913] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:45.539167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a0cf-c5bd-49b7-bd2b-9cadafbb9d2d service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.549487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a0cf-c5bd-49b7-bd2b-9cadafbb9d2d service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.560002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:45.599702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:45.603620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcb1f2-8dba-4ee7-be2d-fcdb4305b786 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.614886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.614886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.614886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.614886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.615197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.622129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a667fb-6f99-402d-8a02-f922c6f3a855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.622852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a667fb-6f99-402d-8a02-f922c6f3a855 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.623121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a667fb-6f99-402d-8a02-f922c6f3a855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.623386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a667fb-6f99-402d-8a02-f922c6f3a855 admin admin] PATH_INFO: `/v3/projects/cba5787e55974fa299f6c451bfe0bd34/users/438c7a65cc454b8c96309aed09ec9f16/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.638266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a667fb-6f99-402d-8a02-f922c6f3a855 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba5787e55974fa299f6c451bfe0bd34, user_id=438c7a65cc454b8c96309aed09ec9f16, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.640933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a667fb-6f99-402d-8a02-f922c6f3a855 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.659494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 956/1914] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:45 2022] PUT /identity/v3/projects/cba5787e55974fa299f6c451bfe0bd34/users/438c7a65cc454b8c96309aed09ec9f16/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:45.660836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bcf9f-7b03-43c1-b9ff-b86c163dce46 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.661059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bcf9f-7b03-43c1-b9ff-b86c163dce46 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.661325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bcf9f-7b03-43c1-b9ff-b86c163dce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.683828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4d5bcf9f-7b03-43c1-b9ff-b86c163dce46 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:45.686652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4d5bcf9f-7b03-43c1-b9ff-b86c163dce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.703181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.704885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.715136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 959/1915] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:45.716701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.718104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.733984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d87d2-4c5e-48ee-8b46-0e6d0bca07ed service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.815519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 957/1916] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:45.816528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bcf9f-7b03-43c1-b9ff-b86c163dce46 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.819584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4d5bcf9f-7b03-43c1-b9ff-b86c163dce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.839498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bcf9f-7b03-43c1-b9ff-b86c163dce46 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.840361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.849807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.849807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.849807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.857937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cad0a0-8957-4ddb-b9c8-c859b0e90e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.858579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad0a0-8957-4ddb-b9c8-c859b0e90e53 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.858856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad0a0-8957-4ddb-b9c8-c859b0e90e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.859125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cad0a0-8957-4ddb-b9c8-c859b0e90e53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.859254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.859775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad0a0-8957-4ddb-b9c8-c859b0e90e53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.861514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cad0a0-8957-4ddb-b9c8-c859b0e90e53 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.883794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 958/1917] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:45.885723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3a48-46e0-4417-ac29-bd34d95cf026 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.886041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3a48-46e0-4417-ac29-bd34d95cf026 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.886327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579d3a48-46e0-4417-ac29-bd34d95cf026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.916657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-579d3a48-46e0-4417-ac29-bd34d95cf026 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:45.918772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-579d3a48-46e0-4417-ac29-bd34d95cf026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:45.929441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 959/1918] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:45.930908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d3a48-46e0-4417-ac29-bd34d95cf026 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.942794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.944415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579d3a48-46e0-4417-ac29-bd34d95cf026 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.944527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.956185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 960/1919] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:45.956945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:45.962099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88e035-b778-4c3a-9b63-1fbb5512fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.963647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e035-b778-4c3a-9b63-1fbb5512fc86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.963934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e035-b778-4c3a-9b63-1fbb5512fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.964206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88e035-b778-4c3a-9b63-1fbb5512fc86 admin admin] PATH_INFO: `/v3/projects/cba5787e55974fa299f6c451bfe0bd34/users/438c7a65cc454b8c96309aed09ec9f16/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.967084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88e035-b778-4c3a-9b63-1fbb5512fc86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cba5787e55974fa299f6c451bfe0bd34, user_id=438c7a65cc454b8c96309aed09ec9f16, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.969744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bbdda-dbd3-4709-b18f-41d2de0d6f5e service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:45.969974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88e035-b778-4c3a-9b63-1fbb5512fc86 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.980716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:45.980716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:45.980716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:45.980716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:45.981108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:45.981108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:45.983375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:45.983946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 960/1920] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:45 2022] PUT /identity/v3/projects/cba5787e55974fa299f6c451bfe0bd34/users/438c7a65cc454b8c96309aed09ec9f16/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:46.003085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3507a8-efc7-488e-9e71-085d13dc1896 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.003241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3507a8-efc7-488e-9e71-085d13dc1896 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.003514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3507a8-efc7-488e-9e71-085d13dc1896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.009790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 961/1921] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:46.011705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.038069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb100c9-2f49-4af9-a54e-1404a534ae5f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.058374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0e3507a8-efc7-488e-9e71-085d13dc1896 None None] MFA Rules not processed for user `438c7a65cc454b8c96309aed09ec9f16`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:46.059721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0e3507a8-efc7-488e-9e71-085d13dc1896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:46.159047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:46.198910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b60cd2-02f6-44cc-9c66-ef077969bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.199611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b60cd2-02f6-44cc-9c66-ef077969bbd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.200600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b60cd2-02f6-44cc-9c66-ef077969bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.200976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b60cd2-02f6-44cc-9c66-ef077969bbd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.204611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b60cd2-02f6-44cc-9c66-ef077969bbd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.207956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b60cd2-02f6-44cc-9c66-ef077969bbd7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.228300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:46.272409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 961/1922] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:46.276250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 962/1923] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:46 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:46.280559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3507a8-efc7-488e-9e71-085d13dc1896 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.292577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b60cd2-02f6-44cc-9c66-ef077969bbd7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.308445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3507a8-efc7-488e-9e71-085d13dc1896 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.392598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b60cd2-02f6-44cc-9c66-ef077969bbd7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.399350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5cd4-4481-49df-a2c8-fabdfe440e8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.400052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5cd4-4481-49df-a2c8-fabdfe440e8f service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.400331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5cd4-4481-49df-a2c8-fabdfe440e8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.400600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac5cd4-4481-49df-a2c8-fabdfe440e8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.422545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12684-8ee3-4965-8a2f-ef6a8fdf464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.423182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12684-8ee3-4965-8a2f-ef6a8fdf464e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.423594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12684-8ee3-4965-8a2f-ef6a8fdf464e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.423877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12684-8ee3-4965-8a2f-ef6a8fdf464e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.424632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12684-8ee3-4965-8a2f-ef6a8fdf464e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.426735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac12684-8ee3-4965-8a2f-ef6a8fdf464e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.457406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 962/1924] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:46 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:37:46.461678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12684-8ee3-4965-8a2f-ef6a8fdf464e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.471882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12684-8ee3-4965-8a2f-ef6a8fdf464e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.480736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c50bc-e977-43a8-9d6a-b6c5c195f1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.481991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c50bc-e977-43a8-9d6a-b6c5c195f1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.482345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c50bc-e977-43a8-9d6a-b6c5c195f1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.482654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c50bc-e977-43a8-9d6a-b6c5c195f1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.483394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c50bc-e977-43a8-9d6a-b6c5c195f1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.484098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5cd4-4481-49df-a2c8-fabdfe440e8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.485013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c50bc-e977-43a8-9d6a-b6c5c195f1e3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.485600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac5cd4-4481-49df-a2c8-fabdfe440e8f service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.496712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 963/1925] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:37:46.498009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 963/1926] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:37:46.503361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5cd4-4481-49df-a2c8-fabdfe440e8f service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.515909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac5cd4-4481-49df-a2c8-fabdfe440e8f service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.521351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d6080-2ae4-43be-a32a-ab0d785bc3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.522063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6080-2ae4-43be-a32a-ab0d785bc3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.522356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6080-2ae4-43be-a32a-ab0d785bc3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.522582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d6080-2ae4-43be-a32a-ab0d785bc3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.523555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d6080-2ae4-43be-a32a-ab0d785bc3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.525570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d6080-2ae4-43be-a32a-ab0d785bc3e5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.536515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 964/1927] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:46.540847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c50bc-e977-43a8-9d6a-b6c5c195f1e3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.552773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c50bc-e977-43a8-9d6a-b6c5c195f1e3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.558583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5c69b-0d5a-4c05-be83-da50575fc018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.559290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c69b-0d5a-4c05-be83-da50575fc018 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.559701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c69b-0d5a-4c05-be83-da50575fc018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.559983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c69b-0d5a-4c05-be83-da50575fc018 admin admin] PATH_INFO: `/v3/projects/9656274ffeab457792679e5edb11f93d/users/05962349b26d487facdf8036aa2f7d9e/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.576300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d6080-2ae4-43be-a32a-ab0d785bc3e5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.580602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5c69b-0d5a-4c05-be83-da50575fc018 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9656274ffeab457792679e5edb11f93d, user_id=05962349b26d487facdf8036aa2f7d9e, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.583676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5c69b-0d5a-4c05-be83-da50575fc018 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.587137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d6080-2ae4-43be-a32a-ab0d785bc3e5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.591870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.592552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.592867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.593219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.595103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:46.600897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 964/1928] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:46 2022] PUT /identity/v3/projects/9656274ffeab457792679e5edb11f93d/users/05962349b26d487facdf8036aa2f7d9e/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:46.605777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998b45-da94-47d9-bdee-573b92062c35 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.606096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998b45-da94-47d9-bdee-573b92062c35 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.606372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7998b45-da94-47d9-bdee-573b92062c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.629053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d7998b45-da94-47d9-bdee-573b92062c35 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:46.630296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d7998b45-da94-47d9-bdee-573b92062c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:46.674643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.676115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.685786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 965/1929] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:46.713872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 965/1930] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:46.722613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.724203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:46.737396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:46.803352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c2acb-64fb-4747-b6fa-cf77529e99a9 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.826940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7998b45-da94-47d9-bdee-573b92062c35 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:46.829019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d7998b45-da94-47d9-bdee-573b92062c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:46.848261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7998b45-da94-47d9-bdee-573b92062c35 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:46.856471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.857466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.857959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.858387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] PATH_INFO: `/v3/users/5bf93de5f1434efdafda0de181cba6a7` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.859830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf93de5f1434efdafda0de181cba6a7)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.864144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.902428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978af176-3612-4d06-98ad-1a8707109fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:46.903117 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978af176-3612-4d06-98ad-1a8707109fdd service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:46.903397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978af176-3612-4d06-98ad-1a8707109fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:46.903743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978af176-3612-4d06-98ad-1a8707109fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:46.939762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:46.943254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978af176-3612-4d06-98ad-1a8707109fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:46.948010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978af176-3612-4d06-98ad-1a8707109fdd service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:46.957921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf93de5f1434efdafda0de181cba6a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:46.959707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf93de5f1434efdafda0de181cba6a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:46.969721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 966/1931] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:46.983237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf93de5f1434efdafda0de181cba6a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:46.998219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf93de5f1434efdafda0de181cba6a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:47.002195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf93de5f1434efdafda0de181cba6a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:47.038825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 966/1932] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:46 2022] DELETE /identity/v3/users/5bf93de5f1434efdafda0de181cba6a7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:47.040772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33a64-6026-4acb-ad71-a14a7f11a890 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:47.041066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33a64-6026-4acb-ad71-a14a7f11a890 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:47.041370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33a64-6026-4acb-ad71-a14a7f11a890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:47.085038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-aba33a64-6026-4acb-ad71-a14a7f11a890 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:47.087017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aba33a64-6026-4acb-ad71-a14a7f11a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:47.163307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 967/1933] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:47.174936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:47.176397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:47.276300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923dfb41-6775-41a4-820a-48067752d789 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:47.299934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc63d7b-8408-4acb-87db-3c1b72a857dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:47.301669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63d7b-8408-4acb-87db-3c1b72a857dd service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:47.301954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63d7b-8408-4acb-87db-3c1b72a857dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:47.302563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc63d7b-8408-4acb-87db-3c1b72a857dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:47.311865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba33a64-6026-4acb-ad71-a14a7f11a890 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:47.313789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aba33a64-6026-4acb-ad71-a14a7f11a890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:47.320116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc63d7b-8408-4acb-87db-3c1b72a857dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:47.325070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc63d7b-8408-4acb-87db-3c1b72a857dd service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:47.342802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 967/1934] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:47.402705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba33a64-6026-4acb-ad71-a14a7f11a890 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:47.407663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656871-ec02-43a4-89f3-c057cd001fcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:47.408480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656871-ec02-43a4-89f3-c057cd001fcf service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:47.409245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656871-ec02-43a4-89f3-c057cd001fcf service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:47.409245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656871-ec02-43a4-89f3-c057cd001fcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:47.412921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-08656871-ec02-43a4-89f3-c057cd001fcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:47.451711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:47.505431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656871-ec02-43a4-89f3-c057cd001fcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:47.507291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08656871-ec02-43a4-89f3-c057cd001fcf service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:47.521648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 968/1935] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:47.592501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd3d45-64b0-4fb2-b650-f33d1779923a None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:47.593063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd3d45-64b0-4fb2-b650-f33d1779923a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:47.593611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd3d45-64b0-4fb2-b650-f33d1779923a None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:47.596024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 968/1936] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:37:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:37:47.634539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a4bc-23b3-4c15-81bb-64563dc5aac3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:47.635293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a4bc-23b3-4c15-81bb-64563dc5aac3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:47.635836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9a4bc-23b3-4c15-81bb-64563dc5aac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:47.673557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ecc9a4bc-23b3-4c15-81bb-64563dc5aac3 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:47.676922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ecc9a4bc-23b3-4c15-81bb-64563dc5aac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:47.827312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 969/1937] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:37:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:47.862214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd3d45-64b0-4fb2-b650-f33d1779923a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:47.864187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7dbd3d45-64b0-4fb2-b650-f33d1779923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:47.894754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd3d45-64b0-4fb2-b650-f33d1779923a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:47.939104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f48ec0-83d9-4004-8098-61e073ede31b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:47.939765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48ec0-83d9-4004-8098-61e073ede31b service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:47.940037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48ec0-83d9-4004-8098-61e073ede31b service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:47.941158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f48ec0-83d9-4004-8098-61e073ede31b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:47.956147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a4bc-23b3-4c15-81bb-64563dc5aac3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:47.957606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ecc9a4bc-23b3-4c15-81bb-64563dc5aac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:47.988702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f48ec0-83d9-4004-8098-61e073ede31b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:47.990679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f48ec0-83d9-4004-8098-61e073ede31b service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:48.011785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9a4bc-23b3-4c15-81bb-64563dc5aac3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:48.017312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 969/1938] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:48.021231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637feb74-b8c2-4c8c-8d86-7dbc048dbe33 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:48.021516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637feb74-b8c2-4c8c-8d86-7dbc048dbe33 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:48.021824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637feb74-b8c2-4c8c-8d86-7dbc048dbe33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:48.025892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:48.026883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:48.027787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:48.029003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] PATH_INFO: `/v3/projects/11bb00e05653481eb6e9c3f89aba8d3e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:48.033477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11bb00e05653481eb6e9c3f89aba8d3e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:48.035741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:48.065895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-637feb74-b8c2-4c8c-8d86-7dbc048dbe33 None None] MFA Rules not processed for user `05962349b26d487facdf8036aa2f7d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:48.067750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-637feb74-b8c2-4c8c-8d86-7dbc048dbe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:48.104513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11bb00e05653481eb6e9c3f89aba8d3e', 'request_id': 'req-482cbe7b-e59a-4e81-a91f-aa5f52d56171'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.112619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11bb00e05653481eb6e9c3f89aba8d3e', 'request_id': 'req-482cbe7b-e59a-4e81-a91f-aa5f52d56171'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.130437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11bb00e05653481eb6e9c3f89aba8d3e', 'request_id': 'req-482cbe7b-e59a-4e81-a91f-aa5f52d56171'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.144873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] The token cache is being invalidate because project 11bb00e05653481eb6e9c3f89aba8d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:48.145260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.151981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.156630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 970/1939] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:47 2022] DELETE /identity/v3/projects/11bb00e05653481eb6e9c3f89aba8d3e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:48.156630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:48.156630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:48.201963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 970/1940] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:48.202671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637feb74-b8c2-4c8c-8d86-7dbc048dbe33 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:48.206160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-637feb74-b8c2-4c8c-8d86-7dbc048dbe33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:48.213304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:48.263581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637feb74-b8c2-4c8c-8d86-7dbc048dbe33 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:48.264083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cbe7b-e59a-4e81-a91f-aa5f52d56171 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:48.269039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:48.269783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:48.270065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:48.270667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] PATH_INFO: `/v3/users/cc2e5f9b05814abfba4ab295f885522c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:48.272835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2e5f9b05814abfba4ab295f885522c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:48.275640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:48.284298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:48.285596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:48.286042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:48.286454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] PATH_INFO: `/v3/users/500ac936b5954180856d425cb63821d3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:48.288201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=500ac936b5954180856d425cb63821d3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:48.293991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:48.374208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:48.412307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '500ac936b5954180856d425cb63821d3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.414858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '500ac936b5954180856d425cb63821d3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.416486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2e5f9b05814abfba4ab295f885522c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.417496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2e5f9b05814abfba4ab295f885522c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.430566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '500ac936b5954180856d425cb63821d3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.439389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2e5f9b05814abfba4ab295f885522c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.454169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '500ac936b5954180856d425cb63821d3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.454993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '500ac936b5954180856d425cb63821d3'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.473258 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2e5f9b05814abfba4ab295f885522c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.473970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-653c751f-5e59-4ad8-b3c3-2a46925c0f27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2e5f9b05814abfba4ab295f885522c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:48.483714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 971/1941] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:48 2022] DELETE /identity/v3/users/500ac936b5954180856d425cb63821d3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:48.484555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:48.485974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:48.509235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 971/1942] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:48 2022] DELETE /identity/v3/users/cc2e5f9b05814abfba4ab295f885522c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:48.511852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fd544-8b2a-421c-9c42-a74756763ad4 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:48.512149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fd544-8b2a-421c-9c42-a74756763ad4 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:48.512429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814fd544-8b2a-421c-9c42-a74756763ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:48.558758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-814fd544-8b2a-421c-9c42-a74756763ad4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:48.560596 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-814fd544-8b2a-421c-9c42-a74756763ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:48.596830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e283f-b517-4165-9c05-4990fa6444b6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:48.720298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 972/1943] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:48.729988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fd544-8b2a-421c-9c42-a74756763ad4 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:48.731556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-814fd544-8b2a-421c-9c42-a74756763ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:48.739222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:48.739909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:48.740327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:48.740601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:48.741260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:48.743476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:48.787938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 972/1944] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:48 2022] POST /identity/v3/projects => generated 373 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:48.791532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:48.794185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:48.917582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:48.943919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814fd544-8b2a-421c-9c42-a74756763ad4 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:48.950991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:48.974149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de3cda-53fa-4325-9a6e-e075f4c4463b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:48.997585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250191-4f91-4a99-b1be-cff2d41c66dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:48.998267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250191-4f91-4a99-b1be-cff2d41c66dd admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:48.998546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250191-4f91-4a99-b1be-cff2d41c66dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.003225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250191-4f91-4a99-b1be-cff2d41c66dd admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.003981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250191-4f91-4a99-b1be-cff2d41c66dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.009952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250191-4f91-4a99-b1be-cff2d41c66dd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.047048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ab916-0e51-4b72-8f5c-555c12ad5964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.048077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ab916-0e51-4b72-8f5c-555c12ad5964 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.048496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ab916-0e51-4b72-8f5c-555c12ad5964 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.049049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ab916-0e51-4b72-8f5c-555c12ad5964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.061080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ab916-0e51-4b72-8f5c-555c12ad5964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.063483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ab916-0e51-4b72-8f5c-555c12ad5964 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.077536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 973/1945] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:49.085856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 973/1946] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:48 2022] POST /identity/v3/users => generated 293 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:37:49.087176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ab916-0e51-4b72-8f5c-555c12ad5964 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.114159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ab916-0e51-4b72-8f5c-555c12ad5964 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.132143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.135031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.136244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.138973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.140046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.142430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.173493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250191-4f91-4a99-b1be-cff2d41c66dd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.174778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 974/1947] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:49.202007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250191-4f91-4a99-b1be-cff2d41c66dd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.213520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dbfeb-5ab3-40b1-b62d-87dae0e3aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.214195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dbfeb-5ab3-40b1-b62d-87dae0e3aae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.214751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dbfeb-5ab3-40b1-b62d-87dae0e3aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.214856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dbfeb-5ab3-40b1-b62d-87dae0e3aae2 admin admin] PATH_INFO: `/v3/projects/c0ea8be9cbc546d58d939bb2cf619423/users/f1785a41b8cc4f93b6d77a130d508594/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.245559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dbfeb-5ab3-40b1-b62d-87dae0e3aae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ea8be9cbc546d58d939bb2cf619423, user_id=f1785a41b8cc4f93b6d77a130d508594, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.248581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dbfeb-5ab3-40b1-b62d-87dae0e3aae2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.262910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.266239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:49.277210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 974/1948] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:49 2022] PUT /identity/v3/projects/c0ea8be9cbc546d58d939bb2cf619423/users/f1785a41b8cc4f93b6d77a130d508594/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:49.280555 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dbfeb-5ab3-40b1-b62d-87dae0e3aae2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.305826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9222c6-93c7-4eba-9d16-bb3e973b5a42 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.406599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dbfeb-5ab3-40b1-b62d-87dae0e3aae2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.415539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff6d2e-f3d1-402a-b6dc-ac21ad816d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.416173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.416320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff6d2e-f3d1-402a-b6dc-ac21ad816d1d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.416680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff6d2e-f3d1-402a-b6dc-ac21ad816d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.416865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ff6d2e-f3d1-402a-b6dc-ac21ad816d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.417631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff6d2e-f3d1-402a-b6dc-ac21ad816d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.418493 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.419113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.419729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ff6d2e-f3d1-402a-b6dc-ac21ad816d1d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.420040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] PATH_INFO: `/v3/projects/c05ce152000a47b384b1fc61098ddb98` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.422531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05ce152000a47b384b1fc61098ddb98)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.425270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.436389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 975/1949] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:49.441508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff6d2e-f3d1-402a-b6dc-ac21ad816d1d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.457348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ff6d2e-f3d1-402a-b6dc-ac21ad816d1d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.462263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.462937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.463210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.463479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] PATH_INFO: `/v3/projects/c0ea8be9cbc546d58d939bb2cf619423/users/f1785a41b8cc4f93b6d77a130d508594/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.465966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ea8be9cbc546d58d939bb2cf619423, user_id=f1785a41b8cc4f93b6d77a130d508594, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.468944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.486884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 976/1950] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:49 2022] PUT /identity/v3/projects/c0ea8be9cbc546d58d939bb2cf619423/users/f1785a41b8cc4f93b6d77a130d508594/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:49.529549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05ce152000a47b384b1fc61098ddb98', 'request_id': 'req-861c2eed-2793-490d-b8e8-ced4b78c268e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.538540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05ce152000a47b384b1fc61098ddb98', 'request_id': 'req-861c2eed-2793-490d-b8e8-ced4b78c268e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.546930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.549022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:49.553957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05ce152000a47b384b1fc61098ddb98', 'request_id': 'req-861c2eed-2793-490d-b8e8-ced4b78c268e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.575829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] The token cache is being invalidate because project c05ce152000a47b384b1fc61098ddb98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:49.576203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.577267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-861c2eed-2793-490d-b8e8-ced4b78c268e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.579448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 975/1951] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:49 2022] DELETE /identity/v3/projects/c05ce152000a47b384b1fc61098ddb98 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:49.587446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70ea39-bb53-477c-98ee-2d70a61a89a5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.587843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70ea39-bb53-477c-98ee-2d70a61a89a5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.588184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70ea39-bb53-477c-98ee-2d70a61a89a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.614814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0c70ea39-bb53-477c-98ee-2d70a61a89a5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:49.616980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0c70ea39-bb53-477c-98ee-2d70a61a89a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:49.641799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d518c-3e9a-4f5a-8940-8039b38a64ee admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.647687 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:49.703117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:49.730162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 976/1952] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:49.737973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e6745-7b0c-4b3b-973a-d635eadc48c0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.738353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e6745-7b0c-4b3b-973a-d635eadc48c0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.738872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e6745-7b0c-4b3b-973a-d635eadc48c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.745200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.745896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.746178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.746463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] PATH_INFO: `/v3/projects/9370e2ebcdc34733a0643c3f67afc18c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.747849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9370e2ebcdc34733a0643c3f67afc18c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.749972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.762595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fc0e6745-7b0c-4b3b-973a-d635eadc48c0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:49.765368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fc0e6745-7b0c-4b3b-973a-d635eadc48c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:49.781988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 977/1953] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:49.786117 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e6745-7b0c-4b3b-973a-d635eadc48c0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.797734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e6745-7b0c-4b3b-973a-d635eadc48c0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.823960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9370e2ebcdc34733a0643c3f67afc18c', 'request_id': 'req-d4383f8d-11dd-40b3-8592-5fd2b303e844'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.832072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9370e2ebcdc34733a0643c3f67afc18c', 'request_id': 'req-d4383f8d-11dd-40b3-8592-5fd2b303e844'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.841329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9370e2ebcdc34733a0643c3f67afc18c', 'request_id': 'req-d4383f8d-11dd-40b3-8592-5fd2b303e844'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.860735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] The token cache is being invalidate because project 9370e2ebcdc34733a0643c3f67afc18c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:49.861112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.862367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:49.864770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 977/1954] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:49 2022] DELETE /identity/v3/projects/9370e2ebcdc34733a0643c3f67afc18c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:49.868544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.873504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:49.890711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.891548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.892440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.892939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.893921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:49.894332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.910076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.932890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 978/1955] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:37:49.937308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:49.939432 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:49.954530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794e3b6-c994-4001-bd0b-4fb9816c8b48 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.963465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893dbbe-ef8d-4b8e-acff-fa9d2ad3a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.964658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893dbbe-ef8d-4b8e-acff-fa9d2ad3a8ae admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.964944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893dbbe-ef8d-4b8e-acff-fa9d2ad3a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:49.965287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893dbbe-ef8d-4b8e-acff-fa9d2ad3a8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:49.966345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893dbbe-ef8d-4b8e-acff-fa9d2ad3a8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:49.968664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893dbbe-ef8d-4b8e-acff-fa9d2ad3a8ae admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:49.981423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4383f8d-11dd-40b3-8592-5fd2b303e844 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:49.996745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:49.997672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:49.998079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:50.001823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] PATH_INFO: `/v3/users/308234da979742c0b7dd0b06699da9de` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:50.004773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308234da979742c0b7dd0b06699da9de)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:50.008557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:50.015039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 979/1956] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:49 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:50.024356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893dbbe-ef8d-4b8e-acff-fa9d2ad3a8ae admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:50.086324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308234da979742c0b7dd0b06699da9de'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:50.087172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308234da979742c0b7dd0b06699da9de'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:50.098206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308234da979742c0b7dd0b06699da9de'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:50.108148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308234da979742c0b7dd0b06699da9de'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:50.109110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308234da979742c0b7dd0b06699da9de'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:50.117336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:50.117535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893dbbe-ef8d-4b8e-acff-fa9d2ad3a8ae admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:50.122992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e62e4-c358-4e84-b2a6-b4c991d97860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:50.123755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e62e4-c358-4e84-b2a6-b4c991d97860 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:50.124285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e62e4-c358-4e84-b2a6-b4c991d97860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:50.124651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e62e4-c358-4e84-b2a6-b4c991d97860 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:50.125610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e62e4-c358-4e84-b2a6-b4c991d97860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:50.128133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63e62e4-c358-4e84-b2a6-b4c991d97860 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:50.136190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 978/1957] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:49 2022] DELETE /identity/v3/users/308234da979742c0b7dd0b06699da9de => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:50.163663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 980/1958] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:50 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:50.167805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:50.169289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:50.260411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc9374-d44e-4aef-8caa-94550b665da7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:50.267795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270837bf-1de7-43a1-b5d6-ba53a956846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:50.268579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270837bf-1de7-43a1-b5d6-ba53a956846e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:50.268990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270837bf-1de7-43a1-b5d6-ba53a956846e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:50.269272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270837bf-1de7-43a1-b5d6-ba53a956846e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:50.270083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270837bf-1de7-43a1-b5d6-ba53a956846e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:50.271877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270837bf-1de7-43a1-b5d6-ba53a956846e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:50.300232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 979/1959] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:50.305963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e62e4-c358-4e84-b2a6-b4c991d97860 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:50.320279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e62e4-c358-4e84-b2a6-b4c991d97860 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:50.327030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14e651-6305-42f3-86eb-b8e712d137ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:50.327976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14e651-6305-42f3-86eb-b8e712d137ed admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:50.328250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14e651-6305-42f3-86eb-b8e712d137ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:50.328774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14e651-6305-42f3-86eb-b8e712d137ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:50.329480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14e651-6305-42f3-86eb-b8e712d137ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:50.331114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14e651-6305-42f3-86eb-b8e712d137ed admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:50.344614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 981/1960] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:37:50.347913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270837bf-1de7-43a1-b5d6-ba53a956846e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:50.363678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270837bf-1de7-43a1-b5d6-ba53a956846e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:50.371763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:50.373157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:50.373547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:50.373853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] PATH_INFO: `/v3/projects/aa09b236649641279a5d153de39dd45f/users/4c54523567ea48bca7802aadebf86e58/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:50.424047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa09b236649641279a5d153de39dd45f, user_id=4c54523567ea48bca7802aadebf86e58, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:50.429044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:50.453145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 980/1961] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:50 2022] PUT /identity/v3/projects/aa09b236649641279a5d153de39dd45f/users/4c54523567ea48bca7802aadebf86e58/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:50.464469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a5e8-de06-461f-b27a-668f3cdf52d2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:50.464896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a5e8-de06-461f-b27a-668f3cdf52d2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:50.465215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77a5e8-de06-461f-b27a-668f3cdf52d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:50.499629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:50.505530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7d77a5e8-de06-461f-b27a-668f3cdf52d2 None None] MFA Rules not processed for user `4c54523567ea48bca7802aadebf86e58`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:50.510097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7d77a5e8-de06-461f-b27a-668f3cdf52d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:50.673918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 982/1962] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:50.684931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:50.686760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:50.737606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7ba43-ca06-4d92-99f1-45bce26fa683 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:50.737886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7ba43-ca06-4d92-99f1-45bce26fa683 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:50.738114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db7ba43-ca06-4d92-99f1-45bce26fa683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:50.795324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6db7ba43-ca06-4d92-99f1-45bce26fa683 None None] MFA Rules not processed for user `f1785a41b8cc4f93b6d77a130d508594`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:50.797265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6db7ba43-ca06-4d92-99f1-45bce26fa683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:50.832112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a97bc3-2552-4774-b528-a6b0e05f34eb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:50.839623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46c91e383f44555b753b6500c9cdc44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:50.840366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:50.840668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:50.840941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:50.851196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:50.852722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:50.875077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 981/1963] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:50.876182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:50.879803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:50.984690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:51.008941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 983/1964] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:51.011352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3156-68bc-4c8f-92a0-1d9e229fe8a0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.011640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3156-68bc-4c8f-92a0-1d9e229fe8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.011913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6a3156-68bc-4c8f-92a0-1d9e229fe8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.045537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b0421-2e53-4bec-a713-e29cf8cb312f service glance] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:51.053793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:51.054673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.055112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.055472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] PATH_INFO: `/v3/projects/6022ed0116e1417fb5cd75624bb0101e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.059457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3b6a3156-68bc-4c8f-92a0-1d9e229fe8a0 None None] MFA Rules not processed for user `05962349b26d487facdf8036aa2f7d9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:51.061204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b6a3156-68bc-4c8f-92a0-1d9e229fe8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.072701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6022ed0116e1417fb5cd75624bb0101e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:51.083589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:51.173404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 984/1965] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:51.264451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3156-68bc-4c8f-92a0-1d9e229fe8a0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:51.267312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b6a3156-68bc-4c8f-92a0-1d9e229fe8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.294759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6022ed0116e1417fb5cd75624bb0101e', 'request_id': 'req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.316928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6022ed0116e1417fb5cd75624bb0101e', 'request_id': 'req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.351911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6022ed0116e1417fb5cd75624bb0101e', 'request_id': 'req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.360090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:51.385003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] The token cache is being invalidate because project 6022ed0116e1417fb5cd75624bb0101e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:51.385297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.386123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a9c9bfb1-a64f-4a4f-aca4-e37b2d82a8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.387735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 982/1966] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:50 2022] DELETE /identity/v3/projects/6022ed0116e1417fb5cd75624bb0101e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:51.392581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fea3d-85ba-48cd-8820-8fe38bc2bfd9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.392932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fea3d-85ba-48cd-8820-8fe38bc2bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.393272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fea3d-85ba-48cd-8820-8fe38bc2bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.424463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6a3156-68bc-4c8f-92a0-1d9e229fe8a0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:51.431223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3a8fea3d-85ba-48cd-8820-8fe38bc2bfd9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:51.432348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3a8fea3d-85ba-48cd-8820-8fe38bc2bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.502617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 983/1967] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:51.503959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fea3d-85ba-48cd-8820-8fe38bc2bfd9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:51.505743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3a8fea3d-85ba-48cd-8820-8fe38bc2bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.513310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3ab03e-9bed-4605-888f-f7efb0a7aa46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:51.513985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ab03e-9bed-4605-888f-f7efb0a7aa46 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.514284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ab03e-9bed-4605-888f-f7efb0a7aa46 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.514660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3ab03e-9bed-4605-888f-f7efb0a7aa46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.516469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8c3ab03e-9bed-4605-888f-f7efb0a7aa46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.522726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fea3d-85ba-48cd-8820-8fe38bc2bfd9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:51.530321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:51.531368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.531985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.532454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] PATH_INFO: `/v3/users/f2065de0d82c4ecd925bc002fd22e053` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.534176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2065de0d82c4ecd925bc002fd22e053)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:51.537134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:51.599499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ab03e-9bed-4605-888f-f7efb0a7aa46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:51.601728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3ab03e-9bed-4605-888f-f7efb0a7aa46 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:51.610230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2065de0d82c4ecd925bc002fd22e053'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.611500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2065de0d82c4ecd925bc002fd22e053'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.612974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 985/1968] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:51.614622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d597-1651-4fcd-8d73-a845f9a54d2c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.615142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d597-1651-4fcd-8d73-a845f9a54d2c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.615425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9904d597-1651-4fcd-8d73-a845f9a54d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.645103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9904d597-1651-4fcd-8d73-a845f9a54d2c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:51.646935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9904d597-1651-4fcd-8d73-a845f9a54d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.650301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2065de0d82c4ecd925bc002fd22e053'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.659213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 986/1969] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:51.663576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904d597-1651-4fcd-8d73-a845f9a54d2c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:51.673101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2065de0d82c4ecd925bc002fd22e053'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.673412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9904d597-1651-4fcd-8d73-a845f9a54d2c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:51.674826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-95886a08-7ed2-4fe4-a4c2-c5dbcc3d9116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2065de0d82c4ecd925bc002fd22e053'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:51.678349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:51.678959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.679233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.679563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.680374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:51.680491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:51.682425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:51.695000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:51.712417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 987/1970] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:51.714325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:51.721078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.733666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 984/1971] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:51 2022] DELETE /identity/v3/users/f2065de0d82c4ecd925bc002fd22e053 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:51.737836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e214-9dde-45fe-ac9d-558a38187731 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.738377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e214-9dde-45fe-ac9d-558a38187731 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.738862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e214-9dde-45fe-ac9d-558a38187731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.757795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6bc77c-4022-453b-ab75-92d5eefd2ede admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:51.779862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3bd7e214-9dde-45fe-ac9d-558a38187731 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:51.780828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3bd7e214-9dde-45fe-ac9d-558a38187731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.830155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:51.845523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed715ff-9047-4b0b-9d24-d84ee1305e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:51.846255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed715ff-9047-4b0b-9d24-d84ee1305e52 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.846813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed715ff-9047-4b0b-9d24-d84ee1305e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.846813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed715ff-9047-4b0b-9d24-d84ee1305e52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.847439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed715ff-9047-4b0b-9d24-d84ee1305e52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:51.849365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed715ff-9047-4b0b-9d24-d84ee1305e52 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:51.878209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 985/1972] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:51.888904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e214-9dde-45fe-ac9d-558a38187731 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:51.890709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3bd7e214-9dde-45fe-ac9d-558a38187731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:51.893582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 988/1973] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:51 2022] POST /identity/v3/projects => generated 385 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:51.894671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed715ff-9047-4b0b-9d24-d84ee1305e52 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:51.986188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed715ff-9047-4b0b-9d24-d84ee1305e52 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:51.994529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e214-9dde-45fe-ac9d-558a38187731 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:51.997387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:51.998392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:51.998685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:51.998960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:51.999617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.001580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.076138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 989/1974] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:51 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:52.076138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.079712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:52.091107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45659bd-9d09-4ade-89fd-141d5ddea1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.091740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45659bd-9d09-4ade-89fd-141d5ddea1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.093741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45659bd-9d09-4ade-89fd-141d5ddea1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.094043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45659bd-9d09-4ade-89fd-141d5ddea1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.106241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287106a1-dc2c-4298-8b62-09bf5615a52d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.116266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.117298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.117573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.117873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] PATH_INFO: `/v3/users/713c85f4661649e2801f263e4df2fccc` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.119025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713c85f4661649e2801f263e4df2fccc)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.119199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45659bd-9d09-4ade-89fd-141d5ddea1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.120653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45659bd-9d09-4ade-89fd-141d5ddea1e5 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.120948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.136298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 986/1975] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:37:52.137168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45659bd-9d09-4ade-89fd-141d5ddea1e5 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.149082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45659bd-9d09-4ade-89fd-141d5ddea1e5 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.157021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a7c0-c402-4fc5-870e-e122f21acb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.157810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a7c0-c402-4fc5-870e-e122f21acb32 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.158198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a7c0-c402-4fc5-870e-e122f21acb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.158652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792a7c0-c402-4fc5-870e-e122f21acb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.159341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792a7c0-c402-4fc5-870e-e122f21acb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.161915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4792a7c0-c402-4fc5-870e-e122f21acb32 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.178276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 987/1976] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:52.181458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a7c0-c402-4fc5-870e-e122f21acb32 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.184553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713c85f4661649e2801f263e4df2fccc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:52.185420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713c85f4661649e2801f263e4df2fccc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:52.194461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792a7c0-c402-4fc5-870e-e122f21acb32 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.202704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713c85f4661649e2801f263e4df2fccc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:52.204936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f1d7-f78f-4352-bc63-6d4161525d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.205895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f1d7-f78f-4352-bc63-6d4161525d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.206265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f1d7-f78f-4352-bc63-6d4161525d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.206703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab2f1d7-f78f-4352-bc63-6d4161525d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.207450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f1d7-f78f-4352-bc63-6d4161525d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.209446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab2f1d7-f78f-4352-bc63-6d4161525d20 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.223766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 988/1977] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:52.228153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f1d7-f78f-4352-bc63-6d4161525d20 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.231090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713c85f4661649e2801f263e4df2fccc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:52.232340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f5a8738e-f207-4387-ae75-47758f9cceb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713c85f4661649e2801f263e4df2fccc'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:52.243834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab2f1d7-f78f-4352-bc63-6d4161525d20 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.246808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 990/1978] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:52 2022] DELETE /identity/v3/users/713c85f4661649e2801f263e4df2fccc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:52.251480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614d23b-e536-4b09-b627-4413783b3b3e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.251777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614d23b-e536-4b09-b627-4413783b3b3e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.252416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614d23b-e536-4b09-b627-4413783b3b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.257519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e733a2-b355-4f06-aa8a-6fb2ba0ffab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.258269 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e733a2-b355-4f06-aa8a-6fb2ba0ffab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.258548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e733a2-b355-4f06-aa8a-6fb2ba0ffab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.258946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e733a2-b355-4f06-aa8a-6fb2ba0ffab1 admin admin] PATH_INFO: `/v3/projects/db2de03cad41446ba8e9412dcd22bba3/users/de450c81953f463da3d21c1cf0a153e3/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.276738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e733a2-b355-4f06-aa8a-6fb2ba0ffab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db2de03cad41446ba8e9412dcd22bba3, user_id=de450c81953f463da3d21c1cf0a153e3, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.281286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e733a2-b355-4f06-aa8a-6fb2ba0ffab1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.291681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:52.313891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 989/1979] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:52 2022] PUT /identity/v3/projects/db2de03cad41446ba8e9412dcd22bba3/users/de450c81953f463da3d21c1cf0a153e3/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:52.315829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d031-0a0e-4f88-b8ba-8616ed30fb01 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.316244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d031-0a0e-4f88-b8ba-8616ed30fb01 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.316605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6d031-0a0e-4f88-b8ba-8616ed30fb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.335308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a614d23b-e536-4b09-b627-4413783b3b3e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:52.338598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a614d23b-e536-4b09-b627-4413783b3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:52.356874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d9f6d031-0a0e-4f88-b8ba-8616ed30fb01 None None] MFA Rules not processed for user `de450c81953f463da3d21c1cf0a153e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:52.358203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d9f6d031-0a0e-4f88-b8ba-8616ed30fb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:52.459850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:52.524859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 991/1980] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:52.542809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 990/1981] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:52.544038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614d23b-e536-4b09-b627-4413783b3b3e None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.544830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6d031-0a0e-4f88-b8ba-8616ed30fb01 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.545833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a614d23b-e536-4b09-b627-4413783b3b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:52.549362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d9f6d031-0a0e-4f88-b8ba-8616ed30fb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:52.570197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614d23b-e536-4b09-b627-4413783b3b3e None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.589778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116af50-558b-4a53-a0dc-da9f68de419a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.590416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116af50-558b-4a53-a0dc-da9f68de419a admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.590694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116af50-558b-4a53-a0dc-da9f68de419a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.590959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116af50-558b-4a53-a0dc-da9f68de419a admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.592118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116af50-558b-4a53-a0dc-da9f68de419a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.593631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116af50-558b-4a53-a0dc-da9f68de419a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.637115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6d031-0a0e-4f88-b8ba-8616ed30fb01 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.642402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741269-1daf-4979-af83-23a1e0d62b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.644182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741269-1daf-4979-af83-23a1e0d62b3f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.644698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741269-1daf-4979-af83-23a1e0d62b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.645296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73741269-1daf-4979-af83-23a1e0d62b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.657693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 992/1982] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:52 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:52.659210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116af50-558b-4a53-a0dc-da9f68de419a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.675296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741269-1daf-4979-af83-23a1e0d62b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.677076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73741269-1daf-4979-af83-23a1e0d62b3f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.700959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 991/1983] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:52.796345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116af50-558b-4a53-a0dc-da9f68de419a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.817037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51460-3974-4b93-ba9f-aa20592ff85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.818047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51460-3974-4b93-ba9f-aa20592ff85c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.818360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51460-3974-4b93-ba9f-aa20592ff85c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.818628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab51460-3974-4b93-ba9f-aa20592ff85c admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.820022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab51460-3974-4b93-ba9f-aa20592ff85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.835434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab51460-3974-4b93-ba9f-aa20592ff85c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.887338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 993/1984] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:52 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:52.887993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741269-1daf-4979-af83-23a1e0d62b3f service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.905986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73741269-1daf-4979-af83-23a1e0d62b3f service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.914252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f622cb-3a52-422e-9583-e8fe799268b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.914252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f622cb-3a52-422e-9583-e8fe799268b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.914252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f622cb-3a52-422e-9583-e8fe799268b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.914252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f622cb-3a52-422e-9583-e8fe799268b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.914924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f622cb-3a52-422e-9583-e8fe799268b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.918775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f622cb-3a52-422e-9583-e8fe799268b2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:52.936352 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 992/1985] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:52.940635 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51460-3974-4b93-ba9f-aa20592ff85c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:52.953545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab51460-3974-4b93-ba9f-aa20592ff85c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:52.960909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10f3fe-a1a6-44ba-8cab-a911914f8def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:52.961727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10f3fe-a1a6-44ba-8cab-a911914f8def admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:52.962197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10f3fe-a1a6-44ba-8cab-a911914f8def admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:52.963486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10f3fe-a1a6-44ba-8cab-a911914f8def admin admin] PATH_INFO: `/v3/projects/911183e352a147d1ba3abee3871b9be6/users/dd72d0613a074ded94c2fe81068645e8/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:52.992072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10f3fe-a1a6-44ba-8cab-a911914f8def admin admin] RBAC: Authorizing `identity:create_grant(project_id=911183e352a147d1ba3abee3871b9be6, user_id=dd72d0613a074ded94c2fe81068645e8, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:52.995148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10f3fe-a1a6-44ba-8cab-a911914f8def admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:53.024619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 994/1986] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:52 2022] PUT /identity/v3/projects/911183e352a147d1ba3abee3871b9be6/users/dd72d0613a074ded94c2fe81068645e8/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:53.029283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f622cb-3a52-422e-9583-e8fe799268b2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:53.041868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f622cb-3a52-422e-9583-e8fe799268b2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:53.115205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb8a76-2751-4eaa-a742-f6303881c33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:53.115792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8a76-2751-4eaa-a742-f6303881c33f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:53.116127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8a76-2751-4eaa-a742-f6303881c33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:53.116397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb8a76-2751-4eaa-a742-f6303881c33f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:53.117157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb8a76-2751-4eaa-a742-f6303881c33f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:53.119050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb8a76-2751-4eaa-a742-f6303881c33f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:53.137233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 993/1987] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:53.144684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10f3fe-a1a6-44ba-8cab-a911914f8def admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:53.157269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10f3fe-a1a6-44ba-8cab-a911914f8def admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:53.163518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:53.164337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:53.164682 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:53.165008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] PATH_INFO: `/v3/projects/911183e352a147d1ba3abee3871b9be6/users/dd72d0613a074ded94c2fe81068645e8/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:53.167116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] RBAC: Authorizing `identity:create_grant(project_id=911183e352a147d1ba3abee3871b9be6, user_id=dd72d0613a074ded94c2fe81068645e8, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:53.170114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:53.187106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 995/1988] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:53 2022] PUT /identity/v3/projects/911183e352a147d1ba3abee3871b9be6/users/dd72d0613a074ded94c2fe81068645e8/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:53.200104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261876b1-5404-45d2-a3de-5d0b9c5c4a79 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:53.200104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261876b1-5404-45d2-a3de-5d0b9c5c4a79 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:53.200104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261876b1-5404-45d2-a3de-5d0b9c5c4a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:53.233682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-261876b1-5404-45d2-a3de-5d0b9c5c4a79 None None] MFA Rules not processed for user `dd72d0613a074ded94c2fe81068645e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:53.234954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-261876b1-5404-45d2-a3de-5d0b9c5c4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:53.239977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:53.244364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:53.247677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:53.379510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 994/1989] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:53.380254 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261876b1-5404-45d2-a3de-5d0b9c5c4a79 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:53.381890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-261876b1-5404-45d2-a3de-5d0b9c5c4a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:53.392608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e66f3d-59f8-4a49-a4a9-a763e604005a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:53.408560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:53.409223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:53.409982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:53.409982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] PATH_INFO: `/v3/projects/96e6ca6beb3248ec875e80fed9dcc8d3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:53.411281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e6ca6beb3248ec875e80fed9dcc8d3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:53.414606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:53.425855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:53.465738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261876b1-5404-45d2-a3de-5d0b9c5c4a79 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:53.480275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e6ca6beb3248ec875e80fed9dcc8d3', 'request_id': 'req-2a49db07-827d-4b3b-b99a-a0ef600364c9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.488627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e6ca6beb3248ec875e80fed9dcc8d3', 'request_id': 'req-2a49db07-827d-4b3b-b99a-a0ef600364c9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.499477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e6ca6beb3248ec875e80fed9dcc8d3', 'request_id': 'req-2a49db07-827d-4b3b-b99a-a0ef600364c9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.521073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] The token cache is being invalidate because project 96e6ca6beb3248ec875e80fed9dcc8d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:53.521584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.522457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.524296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 996/1990] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:53 2022] DELETE /identity/v3/projects/96e6ca6beb3248ec875e80fed9dcc8d3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:53.525186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:53.526616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:53.529317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:53.530094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:53.530373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:53.530691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:53.532445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:53.621404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:53.622950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:53.632598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49db07-827d-4b3b-b99a-a0ef600364c9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:53.634279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 995/1991] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:53.635210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:53.636584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:53.651325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:53.652304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:53.652579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:53.652848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] PATH_INFO: `/v3/projects/77a98bb060b94d918db3fd542f198da7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:53.654055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a98bb060b94d918db3fd542f198da7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:53.656249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:53.658844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1ea9-8907-4a2f-8402-4b88ad9ccd09 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:53.673814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:53.675239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:53.676098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:53.676661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] PATH_INFO: `/v3/users/438c7a65cc454b8c96309aed09ec9f16` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:53.681051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] RBAC: Authorizing `identity:delete_user(user_id=438c7a65cc454b8c96309aed09ec9f16)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:53.685535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:53.687892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:53.751589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a98bb060b94d918db3fd542f198da7', 'request_id': 'req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.759709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a98bb060b94d918db3fd542f198da7', 'request_id': 'req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.765874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438c7a65cc454b8c96309aed09ec9f16'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.766662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438c7a65cc454b8c96309aed09ec9f16'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.768871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a98bb060b94d918db3fd542f198da7', 'request_id': 'req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.776852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438c7a65cc454b8c96309aed09ec9f16'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.782979 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] The token cache is being invalidate because project 77a98bb060b94d918db3fd542f198da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:53.783331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.784046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.786016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 997/1992] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:53 2022] DELETE /identity/v3/projects/77a98bb060b94d918db3fd542f198da7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:53.786545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:53.787996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:53.788841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438c7a65cc454b8c96309aed09ec9f16'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.789662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438c7a65cc454b8c96309aed09ec9f16'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:53.821042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 996/1993] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:53 2022] DELETE /identity/v3/users/438c7a65cc454b8c96309aed09ec9f16 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:53.821042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:53.821042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:53.831171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:53.884106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9868db4-d5e4-4bc5-b63e-d09b9e6afd5d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:53.957288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303cb89a-6e3f-49bd-9435-68546504805c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:53.971378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:53.972187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:53.973265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:53.973635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] PATH_INFO: `/v3/users/19732441289c4788b87b2329fc495de4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:53.982134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19732441289c4788b87b2329fc495de4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:53.985957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:54.000308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:54.000948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:54.001225 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:54.001649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] PATH_INFO: `/v3/users/de450c81953f463da3d21c1cf0a153e3` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:54.004397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de450c81953f463da3d21c1cf0a153e3)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:54.006566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:54.118349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19732441289c4788b87b2329fc495de4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.120894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19732441289c4788b87b2329fc495de4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.127669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de450c81953f463da3d21c1cf0a153e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.128710 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de450c81953f463da3d21c1cf0a153e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.135133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19732441289c4788b87b2329fc495de4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.146339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19732441289c4788b87b2329fc495de4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.147754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-309af392-5091-4346-aabd-c05c99270c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19732441289c4788b87b2329fc495de4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.157927 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de450c81953f463da3d21c1cf0a153e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.169231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:54.176573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de450c81953f463da3d21c1cf0a153e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.177313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de450c81953f463da3d21c1cf0a153e3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.182380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 997/1994] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:53 2022] DELETE /identity/v3/users/19732441289c4788b87b2329fc495de4 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:54.205423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8872-23c9-49d7-ae40-e00ae330199d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:54.205423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8872-23c9-49d7-ae40-e00ae330199d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:54.205877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8872-23c9-49d7-ae40-e00ae330199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:54.210227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 998/1995] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:53 2022] DELETE /identity/v3/users/de450c81953f463da3d21c1cf0a153e3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:54.278714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-339f8872-23c9-49d7-ae40-e00ae330199d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:54.278999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-339f8872-23c9-49d7-ae40-e00ae330199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:54.387148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 998/1996] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:54.488238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:54.491128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:54.633598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66ca52-bab0-487b-9996-02aa85a4a327 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:54.648109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f6f87-8596-4a12-bfd3-c6dcb0f5680c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:54.648828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6f87-8596-4a12-bfd3-c6dcb0f5680c service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:54.649343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6f87-8596-4a12-bfd3-c6dcb0f5680c service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:54.649594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f6f87-8596-4a12-bfd3-c6dcb0f5680c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:54.663767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:54.667403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f6f87-8596-4a12-bfd3-c6dcb0f5680c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:54.669875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197f6f87-8596-4a12-bfd3-c6dcb0f5680c service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:54.693606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 999/1997] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:54.722915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f8872-23c9-49d7-ae40-e00ae330199d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:54.724521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-339f8872-23c9-49d7-ae40-e00ae330199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:54.746618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f8872-23c9-49d7-ae40-e00ae330199d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:54.757414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:54.758335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:54.758618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:54.759327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] PATH_INFO: `/v3/projects/cba5787e55974fa299f6c451bfe0bd34` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:54.762159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cba5787e55974fa299f6c451bfe0bd34)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:54.764642 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:54.881742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cba5787e55974fa299f6c451bfe0bd34', 'request_id': 'req-8c71cc2c-91e3-4334-abc8-0a831b05589b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.892385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cba5787e55974fa299f6c451bfe0bd34', 'request_id': 'req-8c71cc2c-91e3-4334-abc8-0a831b05589b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.912727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cba5787e55974fa299f6c451bfe0bd34', 'request_id': 'req-8c71cc2c-91e3-4334-abc8-0a831b05589b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.932444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] The token cache is being invalidate because project cba5787e55974fa299f6c451bfe0bd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:54.932980 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.933848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8c71cc2c-91e3-4334-abc8-0a831b05589b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:54.936109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 999/1998] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:54 2022] DELETE /identity/v3/projects/cba5787e55974fa299f6c451bfe0bd34 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:54.947460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f81f55-cd06-44f9-9c8c-29f39d68dbf9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:54.947749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f81f55-cd06-44f9-9c8c-29f39d68dbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:54.948035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f81f55-cd06-44f9-9c8c-29f39d68dbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:54.972534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b9f81f55-cd06-44f9-9c8c-29f39d68dbf9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:54.973946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b9f81f55-cd06-44f9-9c8c-29f39d68dbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:55.089175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1000/1999] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:55.105812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4a2f-bd5b-4306-b8f1-0a44ee8153cf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.105812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4a2f-bd5b-4306-b8f1-0a44ee8153cf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.105812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c4a2f-bd5b-4306-b8f1-0a44ee8153cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.139064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0b3c4a2f-bd5b-4306-b8f1-0a44ee8153cf None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:55.146444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0b3c4a2f-bd5b-4306-b8f1-0a44ee8153cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:55.185857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1000/2000] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:55.190968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f81f55-cd06-44f9-9c8c-29f39d68dbf9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.203453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f81f55-cd06-44f9-9c8c-29f39d68dbf9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.204953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4a2f-bd5b-4306-b8f1-0a44ee8153cf None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.206708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0b3c4a2f-bd5b-4306-b8f1-0a44ee8153cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:55.209532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.210465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.211622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.212029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.213643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:55.214119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.217335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.261233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1001/2001] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:55.262635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c4a2f-bd5b-4306-b8f1-0a44ee8153cf None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.263720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.280816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.284938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.285795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.288947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] PATH_INFO: `/v3/projects/d60eeff681dc4a85bb2318d5a6b60020` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.292209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60eeff681dc4a85bb2318d5a6b60020)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.295575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.296437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1769b-3d94-4de6-9f2f-cea422632662 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.309952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c19f-88f6-4f59-854c-0b4cb048406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.311013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c19f-88f6-4f59-854c-0b4cb048406e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.311398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c19f-88f6-4f59-854c-0b4cb048406e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.311884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52c19f-88f6-4f59-854c-0b4cb048406e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.314170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c19f-88f6-4f59-854c-0b4cb048406e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.317030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52c19f-88f6-4f59-854c-0b4cb048406e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.405005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1002/2002] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:55 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:55.407201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60eeff681dc4a85bb2318d5a6b60020', 'request_id': 'req-e8a93d82-7a8b-4678-a36b-f432a927ba3b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:55.410756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c19f-88f6-4f59-854c-0b4cb048406e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.418446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60eeff681dc4a85bb2318d5a6b60020', 'request_id': 'req-e8a93d82-7a8b-4678-a36b-f432a927ba3b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:55.427068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60eeff681dc4a85bb2318d5a6b60020', 'request_id': 'req-e8a93d82-7a8b-4678-a36b-f432a927ba3b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:55.443822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:55.451813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] The token cache is being invalidate because project d60eeff681dc4a85bb2318d5a6b60020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:55.452214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:55.453049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8a93d82-7a8b-4678-a36b-f432a927ba3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:55.456812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1001/2003] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:55 2022] DELETE /identity/v3/projects/d60eeff681dc4a85bb2318d5a6b60020 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:55.463806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea53f-3d64-47db-9f40-d7988ebd9f2d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.466310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea53f-3d64-47db-9f40-d7988ebd9f2d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.467692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ea53f-3d64-47db-9f40-d7988ebd9f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.515087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cc3ea53f-3d64-47db-9f40-d7988ebd9f2d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:55.516488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cc3ea53f-3d64-47db-9f40-d7988ebd9f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:55.524794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52c19f-88f6-4f59-854c-0b4cb048406e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.529906 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1002/2004] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:55.537010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.537884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747338e5-3ce5-4db3-8e23-19e2588f11ab None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.538110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.538290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747338e5-3ce5-4db3-8e23-19e2588f11ab None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.538628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.538753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747338e5-3ce5-4db3-8e23-19e2588f11ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.540732 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.541810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.545609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.561069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-747338e5-3ce5-4db3-8e23-19e2588f11ab None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:55.562476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-747338e5-3ce5-4db3-8e23-19e2588f11ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:55.577943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1003/2005] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:55.579795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747338e5-3ce5-4db3-8e23-19e2588f11ab None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.591072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1003/2006] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:55 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:55.592158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747338e5-3ce5-4db3-8e23-19e2588f11ab None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.595552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.598162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:55.609045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.609600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.609918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.610202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.613052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:55.613360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.617514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.630130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63513e26-cc1f-4fed-b605-58cc8b9bc985 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.638777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c5f6-6ec6-4212-b010-a42396412357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.639402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c5f6-6ec6-4212-b010-a42396412357 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.640410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c5f6-6ec6-4212-b010-a42396412357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.640410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6439c5f6-6ec6-4212-b010-a42396412357 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.641038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c5f6-6ec6-4212-b010-a42396412357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.643707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6439c5f6-6ec6-4212-b010-a42396412357 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.652114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1004/2007] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:55.652645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.675262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1004/2008] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:37:55.681071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ef9b9-f393-44e3-8507-f44f6ed397bf admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.683633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c5f6-6ec6-4212-b010-a42396412357 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.694370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31433a42-683b-44ca-87a2-d73d5cae5068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.695300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31433a42-683b-44ca-87a2-d73d5cae5068 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.695721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31433a42-683b-44ca-87a2-d73d5cae5068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.696206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31433a42-683b-44ca-87a2-d73d5cae5068 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.697304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31433a42-683b-44ca-87a2-d73d5cae5068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.699471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31433a42-683b-44ca-87a2-d73d5cae5068 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.706224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6439c5f6-6ec6-4212-b010-a42396412357 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.724282 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2fb68-942a-4ebf-a094-936bbb3b0c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.725257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2fb68-942a-4ebf-a094-936bbb3b0c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.725429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2fb68-942a-4ebf-a094-936bbb3b0c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.725907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2fb68-942a-4ebf-a094-936bbb3b0c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.726895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2fb68-942a-4ebf-a094-936bbb3b0c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.728921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a2fb68-942a-4ebf-a094-936bbb3b0c65 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.754482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1005/2009] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:55 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:55.755644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31433a42-683b-44ca-87a2-d73d5cae5068 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.757782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1005/2010] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:55.759544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2fb68-942a-4ebf-a094-936bbb3b0c65 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.794521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2fb68-942a-4ebf-a094-936bbb3b0c65 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.841097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:55.891432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31433a42-683b-44ca-87a2-d73d5cae5068 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:55.894974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4533e8-47e6-40ca-bbb7-f7c3367aace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.896975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4533e8-47e6-40ca-bbb7-f7c3367aace2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.897363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4533e8-47e6-40ca-bbb7-f7c3367aace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.897938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4533e8-47e6-40ca-bbb7-f7c3367aace2 admin admin] PATH_INFO: `/v3/projects/b6f66f45f84a40b9af0ee5f8a1242aff/users/fd5b31e7fc1d4eed893fd69661b35ee7/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.912630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:55.913305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:55.913649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:55.913956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:55.914618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.916793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.933252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4533e8-47e6-40ca-bbb7-f7c3367aace2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f66f45f84a40b9af0ee5f8a1242aff, user_id=fd5b31e7fc1d4eed893fd69661b35ee7, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:55.939503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4533e8-47e6-40ca-bbb7-f7c3367aace2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:55.976653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1006/2011] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:55 2022] POST /identity/v3/users => generated 296 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:55.976653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:55.982599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:56.010742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b181d1a-6b33-4c64-854a-39e1e0a70e21 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:56.011394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1006/2012] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:55 2022] PUT /identity/v3/projects/b6f66f45f84a40b9af0ee5f8a1242aff/users/fd5b31e7fc1d4eed893fd69661b35ee7/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:56.012577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4533e8-47e6-40ca-bbb7-f7c3367aace2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:56.156556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4533e8-47e6-40ca-bbb7-f7c3367aace2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:56.166929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ac023-d2ca-4e38-acf6-746863380f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:56.167672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ac023-d2ca-4e38-acf6-746863380f70 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:56.170766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ac023-d2ca-4e38-acf6-746863380f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:56.170766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ac023-d2ca-4e38-acf6-746863380f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:56.170766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ac023-d2ca-4e38-acf6-746863380f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:56.172809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:56.173189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:56.173448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:56.173635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] PATH_INFO: `/v3/projects/db2de03cad41446ba8e9412dcd22bba3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:56.174875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db2de03cad41446ba8e9412dcd22bba3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:56.176802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:56.177999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ac023-d2ca-4e38-acf6-746863380f70 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:56.202168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1007/2013] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:56.202168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281eab9-4743-4049-9eea-f4c0add2fc34 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:56.202168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281eab9-4743-4049-9eea-f4c0add2fc34 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:56.202168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281eab9-4743-4049-9eea-f4c0add2fc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:56.258018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d281eab9-4743-4049-9eea-f4c0add2fc34 None None] MFA Rules not processed for user `fd5b31e7fc1d4eed893fd69661b35ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:56.259399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d281eab9-4743-4049-9eea-f4c0add2fc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:56.289965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:56.303364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db2de03cad41446ba8e9412dcd22bba3', 'request_id': 'req-8b3c2898-5552-4dfb-b32a-17ba228ea819'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.324117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db2de03cad41446ba8e9412dcd22bba3', 'request_id': 'req-8b3c2898-5552-4dfb-b32a-17ba228ea819'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.336846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db2de03cad41446ba8e9412dcd22bba3', 'request_id': 'req-8b3c2898-5552-4dfb-b32a-17ba228ea819'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.389667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] The token cache is being invalidate because project db2de03cad41446ba8e9412dcd22bba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:56.390546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.391593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.399364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1007/2014] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:55 2022] DELETE /identity/v3/projects/db2de03cad41446ba8e9412dcd22bba3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:56.400422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:56.407199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:56.418323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1008/2015] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:56.419345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281eab9-4743-4049-9eea-f4c0add2fc34 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:56.455320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281eab9-4743-4049-9eea-f4c0add2fc34 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:56.550387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:56.575902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3c2898-5552-4dfb-b32a-17ba228ea819 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:56.582892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:56.583240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:56.583457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:56.583990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:56.585249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:56.587547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:56.609109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1008/2016] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:56.610205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:56.612228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:56.618918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:56.620539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:56.620822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:56.621155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] PATH_INFO: `/v3/users/dd72d0613a074ded94c2fe81068645e8` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:56.625392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd72d0613a074ded94c2fe81068645e8)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:56.627942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:56.649391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5d755-275a-4041-b5ca-8bf460c53bd2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:56.656644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d91dc-bd72-4cb4-b80d-8cd029ef6c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:56.657696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d91dc-bd72-4cb4-b80d-8cd029ef6c3a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:56.658221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d91dc-bd72-4cb4-b80d-8cd029ef6c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:56.658753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d91dc-bd72-4cb4-b80d-8cd029ef6c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:56.659754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d91dc-bd72-4cb4-b80d-8cd029ef6c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:56.662011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d91dc-bd72-4cb4-b80d-8cd029ef6c3a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:56.713517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1009/2017] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:56 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:56.718522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d91dc-bd72-4cb4-b80d-8cd029ef6c3a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:56.734851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd72d0613a074ded94c2fe81068645e8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.735623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd72d0613a074ded94c2fe81068645e8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.754296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd72d0613a074ded94c2fe81068645e8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.774425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd72d0613a074ded94c2fe81068645e8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.777917 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd72d0613a074ded94c2fe81068645e8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:56.804394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1009/2018] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:37:56 2022] DELETE /identity/v3/users/dd72d0613a074ded94c2fe81068645e8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:56.805387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:56.808911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:56.880261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d91dc-bd72-4cb4-b80d-8cd029ef6c3a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:56.957281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c8709-3186-4135-88c2-50ccd158a3db admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:56.972002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f5364-d0c1-4e28-9035-61933c5951e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:56.972736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f5364-d0c1-4e28-9035-61933c5951e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:56.972993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f5364-d0c1-4e28-9035-61933c5951e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:56.973270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f5364-d0c1-4e28-9035-61933c5951e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:56.973948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f5364-d0c1-4e28-9035-61933c5951e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:56.976354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92f5364-d0c1-4e28-9035-61933c5951e0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:56.988990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:57.007479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc2e12-e12d-497b-81e7-bbcf61250dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.013460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2e12-e12d-497b-81e7-bbcf61250dc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.017593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2e12-e12d-497b-81e7-bbcf61250dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.021855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc2e12-e12d-497b-81e7-bbcf61250dc9 admin admin] PATH_INFO: `/v3/projects/c0dceb73e5654849ad03cae50109f497/users/5bbcd6cb5081421382cae22c542db8f0/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.022025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1010/2019] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:56 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:57.025491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f5364-d0c1-4e28-9035-61933c5951e0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.061865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92f5364-d0c1-4e28-9035-61933c5951e0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.064891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2e12-e12d-497b-81e7-bbcf61250dc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0dceb73e5654849ad03cae50109f497, user_id=5bbcd6cb5081421382cae22c542db8f0, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.068917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc2e12-e12d-497b-81e7-bbcf61250dc9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.075223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3205d1-1888-47e4-a498-fe0ce5d72fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.076013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3205d1-1888-47e4-a498-fe0ce5d72fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.076987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3205d1-1888-47e4-a498-fe0ce5d72fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.077342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3205d1-1888-47e4-a498-fe0ce5d72fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.078351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3205d1-1888-47e4-a498-fe0ce5d72fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.082057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3205d1-1888-47e4-a498-fe0ce5d72fc8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.101490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1010/2020] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:56 2022] PUT /identity/v3/projects/c0dceb73e5654849ad03cae50109f497/users/5bbcd6cb5081421382cae22c542db8f0/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:57.113303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461e03-e032-43e1-ab21-9c5b3fd0bb26 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.113826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461e03-e032-43e1-ab21-9c5b3fd0bb26 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.115136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01461e03-e032-43e1-ab21-9c5b3fd0bb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.121718 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1011/2021] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:57.126407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3205d1-1888-47e4-a498-fe0ce5d72fc8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.144389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3205d1-1888-47e4-a498-fe0ce5d72fc8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.185401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-01461e03-e032-43e1-ab21-9c5b3fd0bb26 None None] MFA Rules not processed for user `5bbcd6cb5081421382cae22c542db8f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:57.188294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-01461e03-e032-43e1-ab21-9c5b3fd0bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:57.192701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:57.226928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2c30-ecf3-4632-afe0-02d8d1a7d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.227744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2c30-ecf3-4632-afe0-02d8d1a7d59f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.228115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2c30-ecf3-4632-afe0-02d8d1a7d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.228526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a2c30-ecf3-4632-afe0-02d8d1a7d59f admin admin] PATH_INFO: `/v3/projects/07c71bf9fa0f4c59865305f727e5aa6b/users/acb78fe7c9744b65974d932218f93c79/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.249505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a2c30-ecf3-4632-afe0-02d8d1a7d59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c71bf9fa0f4c59865305f727e5aa6b, user_id=acb78fe7c9744b65974d932218f93c79, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.252973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a2c30-ecf3-4632-afe0-02d8d1a7d59f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.278112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1012/2022] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:57 2022] PUT /identity/v3/projects/07c71bf9fa0f4c59865305f727e5aa6b/users/acb78fe7c9744b65974d932218f93c79/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:57.279428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2c30-ecf3-4632-afe0-02d8d1a7d59f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.335783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1011/2023] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:57.336863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461e03-e032-43e1-ab21-9c5b3fd0bb26 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.338379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-01461e03-e032-43e1-ab21-9c5b3fd0bb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:57.362559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01461e03-e032-43e1-ab21-9c5b3fd0bb26 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.383500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a2c30-ecf3-4632-afe0-02d8d1a7d59f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.388480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7c8b6-39a5-484c-8a6b-3679dc44f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.389253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7c8b6-39a5-484c-8a6b-3679dc44f921 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.389533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7c8b6-39a5-484c-8a6b-3679dc44f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.389918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7c8b6-39a5-484c-8a6b-3679dc44f921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.390604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7c8b6-39a5-484c-8a6b-3679dc44f921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.392423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7c8b6-39a5-484c-8a6b-3679dc44f921 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.419676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1013/2024] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:57.424286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7c8b6-39a5-484c-8a6b-3679dc44f921 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.450502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7c8b6-39a5-484c-8a6b-3679dc44f921 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.468909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c96bf6-c4a2-4d3b-a5a4-f599343708d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.469614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96bf6-c4a2-4d3b-a5a4-f599343708d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.469924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96bf6-c4a2-4d3b-a5a4-f599343708d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.470347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c96bf6-c4a2-4d3b-a5a4-f599343708d2 admin admin] PATH_INFO: `/v3/projects/07c71bf9fa0f4c59865305f727e5aa6b/users/acb78fe7c9744b65974d932218f93c79/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.472554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c96bf6-c4a2-4d3b-a5a4-f599343708d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07c71bf9fa0f4c59865305f727e5aa6b, user_id=acb78fe7c9744b65974d932218f93c79, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.476577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c96bf6-c4a2-4d3b-a5a4-f599343708d2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.492979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0e302-558b-424e-8a63-183e804674f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.493709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e302-558b-424e-8a63-183e804674f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.494094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e302-558b-424e-8a63-183e804674f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.494946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f0e302-558b-424e-8a63-183e804674f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.495615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0e302-558b-424e-8a63-183e804674f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.498550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f0e302-558b-424e-8a63-183e804674f8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.504157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1014/2025] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:57 2022] PUT /identity/v3/projects/07c71bf9fa0f4c59865305f727e5aa6b/users/acb78fe7c9744b65974d932218f93c79/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:37:57.515340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e6b5e-4edb-4e43-89dd-f4e3c43771fb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.515646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e6b5e-4edb-4e43-89dd-f4e3c43771fb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.515931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e6b5e-4edb-4e43-89dd-f4e3c43771fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.561317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1012/2026] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:57 2022] POST /identity/v3/projects => generated 393 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:57.564001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0e302-558b-424e-8a63-183e804674f8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.568005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-287e6b5e-4edb-4e43-89dd-f4e3c43771fb None None] MFA Rules not processed for user `acb78fe7c9744b65974d932218f93c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:57.570078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-287e6b5e-4edb-4e43-89dd-f4e3c43771fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:57.660329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:57.684286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f0e302-558b-424e-8a63-183e804674f8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.691085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e541342-4eec-4695-96d1-debf371239e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.691962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e541342-4eec-4695-96d1-debf371239e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.692479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e541342-4eec-4695-96d1-debf371239e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.693084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e541342-4eec-4695-96d1-debf371239e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.694149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e541342-4eec-4695-96d1-debf371239e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.696708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1015/2027] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:57.700386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e541342-4eec-4695-96d1-debf371239e8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.708381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e6b5e-4edb-4e43-89dd-f4e3c43771fb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.709853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-287e6b5e-4edb-4e43-89dd-f4e3c43771fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:57.732400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1013/2028] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:57 2022] POST /identity/v3/users => generated 303 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:37:57.736153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e541342-4eec-4695-96d1-debf371239e8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.751411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e541342-4eec-4695-96d1-debf371239e8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.758166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533db2e4-60ad-4ab1-ae71-28094bda19e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.759030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:57.760437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533db2e4-60ad-4ab1-ae71-28094bda19e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.760957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533db2e4-60ad-4ab1-ae71-28094bda19e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.761968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533db2e4-60ad-4ab1-ae71-28094bda19e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.764512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533db2e4-60ad-4ab1-ae71-28094bda19e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.767299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533db2e4-60ad-4ab1-ae71-28094bda19e7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.791248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1014/2029] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:57.795425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533db2e4-60ad-4ab1-ae71-28094bda19e7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.803166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e6b5e-4edb-4e43-89dd-f4e3c43771fb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.807792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.808470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.808823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.809179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.809312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533db2e4-60ad-4ab1-ae71-28094bda19e7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.811313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:57.815096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2961676-5532-4c0f-94bd-56803feade77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.817848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2961676-5532-4c0f-94bd-56803feade77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.817848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2961676-5532-4c0f-94bd-56803feade77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.817848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2961676-5532-4c0f-94bd-56803feade77 admin admin] PATH_INFO: `/v3/projects/76be63075ada45d0a8642d6ef417d4e5/users/e28afbd0bf22482aaef5c904ae102263/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.838663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2961676-5532-4c0f-94bd-56803feade77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76be63075ada45d0a8642d6ef417d4e5, user_id=e28afbd0bf22482aaef5c904ae102263, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.841590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2961676-5532-4c0f-94bd-56803feade77 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.868576 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1015/2030] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:57 2022] PUT /identity/v3/projects/76be63075ada45d0a8642d6ef417d4e5/users/e28afbd0bf22482aaef5c904ae102263/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:57.869938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2961676-5532-4c0f-94bd-56803feade77 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.938121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.940345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:57.959357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1016/2031] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:37:57.960278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:57.962730 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:57.981142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2961676-5532-4c0f-94bd-56803feade77 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:57.988207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c83c6-d939-4a58-a9b4-a6c432d64b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:57.989083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c83c6-d939-4a58-a9b4-a6c432d64b86 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:57.989509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c83c6-d939-4a58-a9b4-a6c432d64b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:57.989956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c83c6-d939-4a58-a9b4-a6c432d64b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:57.990950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c83c6-d939-4a58-a9b4-a6c432d64b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:57.994459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c83c6-d939-4a58-a9b4-a6c432d64b86 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:58.006946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e011fc-8120-4ba5-b315-caf59064bd7f service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:58.012508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:58.013394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.013906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.014353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] PATH_INFO: `/v3/projects/911183e352a147d1ba3abee3871b9be6` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.014903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1016/2032] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:58.016336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=911183e352a147d1ba3abee3871b9be6)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:58.018510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:58.021218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c83c6-d939-4a58-a9b4-a6c432d64b86 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:58.049864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c83c6-d939-4a58-a9b4-a6c432d64b86 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:58.076967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71420390-9159-4b51-92dd-106f4700f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:58.076967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420390-9159-4b51-92dd-106f4700f221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.077289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420390-9159-4b51-92dd-106f4700f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.077537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71420390-9159-4b51-92dd-106f4700f221 admin admin] PATH_INFO: `/v3/projects/76be63075ada45d0a8642d6ef417d4e5/users/e28afbd0bf22482aaef5c904ae102263/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.080517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420390-9159-4b51-92dd-106f4700f221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76be63075ada45d0a8642d6ef417d4e5, user_id=e28afbd0bf22482aaef5c904ae102263, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:58.084404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71420390-9159-4b51-92dd-106f4700f221 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:58.141912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1017/2033] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:58 2022] PUT /identity/v3/projects/76be63075ada45d0a8642d6ef417d4e5/users/e28afbd0bf22482aaef5c904ae102263/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:58.143273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '911183e352a147d1ba3abee3871b9be6', 'request_id': 'req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:58.157206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05303fff-4680-4156-a0f3-95e8a0486354 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.157500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05303fff-4680-4156-a0f3-95e8a0486354 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.157796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05303fff-4680-4156-a0f3-95e8a0486354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.161505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '911183e352a147d1ba3abee3871b9be6', 'request_id': 'req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:58.192662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '911183e352a147d1ba3abee3871b9be6', 'request_id': 'req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:58.218998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] The token cache is being invalidate because project 911183e352a147d1ba3abee3871b9be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:37:58.219297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:58.221627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-fcd0fd07-f7a9-4305-a52e-c27c3cb9b139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:37:58.229805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1017/2034] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:37:57 2022] DELETE /identity/v3/projects/911183e352a147d1ba3abee3871b9be6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:58.231953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b012ec-c11f-492e-b36e-030c7738d7f2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.232248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b012ec-c11f-492e-b36e-030c7738d7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.232677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b012ec-c11f-492e-b36e-030c7738d7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.238789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-05303fff-4680-4156-a0f3-95e8a0486354 None None] MFA Rules not processed for user `e28afbd0bf22482aaef5c904ae102263`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:58.243137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-05303fff-4680-4156-a0f3-95e8a0486354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:58.289681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-14b012ec-c11f-492e-b36e-030c7738d7f2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:58.292913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-14b012ec-c11f-492e-b36e-030c7738d7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:58.422277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1018/2035] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:58.428538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e180-c3ba-4b09-9af9-a5fd803a2718 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.428969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e180-c3ba-4b09-9af9-a5fd803a2718 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.430796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991e180-c3ba-4b09-9af9-a5fd803a2718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.434901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1018/2036] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:58.447756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05303fff-4680-4156-a0f3-95e8a0486354 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:58.447756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-05303fff-4680-4156-a0f3-95e8a0486354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:58.454947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:58.472909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e991e180-c3ba-4b09-9af9-a5fd803a2718 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:58.477403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e991e180-c3ba-4b09-9af9-a5fd803a2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:58.481744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:58.497910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1019/2037] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:37:58.503143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e180-c3ba-4b09-9af9-a5fd803a2718 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:58.519580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991e180-c3ba-4b09-9af9-a5fd803a2718 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:58.543200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:58.546383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.546719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.547019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.549865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:37:58.550186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:58.552302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:58.579689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1020/2038] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:37:58.580487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:58.587716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05303fff-4680-4156-a0f3-95e8a0486354 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:58.593337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ec0ba2-83b2-4363-a00e-ef37eed1c878 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:58.599946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34441d8f-96c7-4e4f-8d7f-040d3c8734ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:58.600623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34441d8f-96c7-4e4f-8d7f-040d3c8734ba service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.602427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34441d8f-96c7-4e4f-8d7f-040d3c8734ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.603034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34441d8f-96c7-4e4f-8d7f-040d3c8734ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.603670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:58.605717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.606080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.606410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.607319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:58.626213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:58.630680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34441d8f-96c7-4e4f-8d7f-040d3c8734ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:58.634187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34441d8f-96c7-4e4f-8d7f-040d3c8734ba service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:58.670149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1019/2039] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:58.699328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1021/2040] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:58 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:58.704126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34441d8f-96c7-4e4f-8d7f-040d3c8734ba service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:58.761027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34441d8f-96c7-4e4f-8d7f-040d3c8734ba service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:58.886626 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:58.893273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:58.921776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7826626-7683-4ce7-90a8-42bfd2baa4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:58.922546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826626-7683-4ce7-90a8-42bfd2baa4fd admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:58.925808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826626-7683-4ce7-90a8-42bfd2baa4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:58.926008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7826626-7683-4ce7-90a8-42bfd2baa4fd admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:58.927382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7826626-7683-4ce7-90a8-42bfd2baa4fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:58.933999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7826626-7683-4ce7-90a8-42bfd2baa4fd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:58.997159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1020/2041] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:58 2022] POST /identity/v3/users => generated 301 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:58.999595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7826626-7683-4ce7-90a8-42bfd2baa4fd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:59.018358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7826626-7683-4ce7-90a8-42bfd2baa4fd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:59.024071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092a4c-1c70-45d4-bb3b-41957a2a5d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:59.024831 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092a4c-1c70-45d4-bb3b-41957a2a5d41 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.025015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092a4c-1c70-45d4-bb3b-41957a2a5d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.025285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b092a4c-1c70-45d4-bb3b-41957a2a5d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.028420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092a4c-1c70-45d4-bb3b-41957a2a5d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:59.028585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b092a4c-1c70-45d4-bb3b-41957a2a5d41 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:59.043823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3458eb-3cd8-4ed1-a7fb-adf0d9176e51 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:59.075079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1021/2042] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:59.075228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:59.075228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.075228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.075228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.076881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092a4c-1c70-45d4-bb3b-41957a2a5d41 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:59.085388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:59.110403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b092a4c-1c70-45d4-bb3b-41957a2a5d41 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:59.130806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a23cfd-6da6-485d-bc37-d844aa3b3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:59.131513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23cfd-6da6-485d-bc37-d844aa3b3e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.131719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23cfd-6da6-485d-bc37-d844aa3b3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.131996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23cfd-6da6-485d-bc37-d844aa3b3e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.132693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a23cfd-6da6-485d-bc37-d844aa3b3e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:59.134547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a23cfd-6da6-485d-bc37-d844aa3b3e7c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:59.153470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1022/2043] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:37:59.154584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a23cfd-6da6-485d-bc37-d844aa3b3e7c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:59.167655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a23cfd-6da6-485d-bc37-d844aa3b3e7c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:59.174134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6019824-2b7e-42e8-a592-6f0fd71ad39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:59.174957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019824-2b7e-42e8-a592-6f0fd71ad39c admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.175505 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019824-2b7e-42e8-a592-6f0fd71ad39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.175956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6019824-2b7e-42e8-a592-6f0fd71ad39c admin admin] PATH_INFO: `/v3/projects/2edc85cd7e5b4a33967ec5088e8d45f7/users/f67838f82a9d413f8ab1fb0242c81a4b/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.211877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6019824-2b7e-42e8-a592-6f0fd71ad39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2edc85cd7e5b4a33967ec5088e8d45f7, user_id=f67838f82a9d413f8ab1fb0242c81a4b, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:59.217842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6019824-2b7e-42e8-a592-6f0fd71ad39c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:59.246336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1023/2044] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:59 2022] PUT /identity/v3/projects/2edc85cd7e5b4a33967ec5088e8d45f7/users/f67838f82a9d413f8ab1fb0242c81a4b/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:59.257935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10127f-3df8-4027-93d4-5b3ec06fabc3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.257935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10127f-3df8-4027-93d4-5b3ec06fabc3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.258343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b10127f-3df8-4027-93d4-5b3ec06fabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.267362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:59.269207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:59.279552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1022/2045] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:37:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:37:59.315945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3b10127f-3df8-4027-93d4-5b3ec06fabc3 None None] MFA Rules not processed for user `f67838f82a9d413f8ab1fb0242c81a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:37:59.317082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3b10127f-3df8-4027-93d4-5b3ec06fabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:37:59.410581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:59.463060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1024/2046] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:37:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:37:59.467350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:59.486570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519be26-dcae-4970-baf9-d125852368d4 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:59.659265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4950a5-be26-4b4b-9b6e-cf7b88a51d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:59.660030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4950a5-be26-4b4b-9b6e-cf7b88a51d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.660362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4950a5-be26-4b4b-9b6e-cf7b88a51d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.660736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4950a5-be26-4b4b-9b6e-cf7b88a51d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.661450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4950a5-be26-4b4b-9b6e-cf7b88a51d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:59.663500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4950a5-be26-4b4b-9b6e-cf7b88a51d64 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:59.703946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1023/2047] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:37:59 2022] POST /identity/v3/projects => generated 399 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:59.708243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10127f-3df8-4027-93d4-5b3ec06fabc3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:59.732919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b10127f-3df8-4027-93d4-5b3ec06fabc3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:59.823183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455da84-b1eb-4120-a8a7-6fd25079abf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:59.823814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455da84-b1eb-4120-a8a7-6fd25079abf4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.824094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455da84-b1eb-4120-a8a7-6fd25079abf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.824519 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455da84-b1eb-4120-a8a7-6fd25079abf4 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.825304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455da84-b1eb-4120-a8a7-6fd25079abf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:59.827375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455da84-b1eb-4120-a8a7-6fd25079abf4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:59.849634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1025/2048] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:37:59 2022] POST /identity/v3/users => generated 306 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:37:59.854335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4950a5-be26-4b4b-9b6e-cf7b88a51d64 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:59.859966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:37:59.865222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4950a5-be26-4b4b-9b6e-cf7b88a51d64 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:59.870594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e9d0c-8cd8-4e9f-9379-fa074bf8ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:59.871195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e9d0c-8cd8-4e9f-9379-fa074bf8ab7c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.871467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e9d0c-8cd8-4e9f-9379-fa074bf8ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.871837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e9d0c-8cd8-4e9f-9379-fa074bf8ab7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.872487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e9d0c-8cd8-4e9f-9379-fa074bf8ab7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:59.874104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62e9d0c-8cd8-4e9f-9379-fa074bf8ab7c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:59.886882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1024/2049] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:37:59.890262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455da84-b1eb-4120-a8a7-6fd25079abf4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:59.900545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455da84-b1eb-4120-a8a7-6fd25079abf4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:37:59.905019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b512-df20-4b7c-a5aa-0298e90263b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:37:59.905666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b512-df20-4b7c-a5aa-0298e90263b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:37:59.905968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b512-df20-4b7c-a5aa-0298e90263b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:37:59.906239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7839b512-df20-4b7c-a5aa-0298e90263b2 admin admin] PATH_INFO: `/v3/projects/04473be9237f4c829d6c32ee013ebb5b/users/2e35b1e311d04d22a7578c30a658c14b/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:37:59.921337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839b512-df20-4b7c-a5aa-0298e90263b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04473be9237f4c829d6c32ee013ebb5b, user_id=2e35b1e311d04d22a7578c30a658c14b, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:37:59.924005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7839b512-df20-4b7c-a5aa-0298e90263b2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:37:59.938523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1026/2050] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:37:59 2022] PUT /identity/v3/projects/04473be9237f4c829d6c32ee013ebb5b/users/2e35b1e311d04d22a7578c30a658c14b/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:37:59.942593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e9d0c-8cd8-4e9f-9379-fa074bf8ab7c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:37:59.953075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e9d0c-8cd8-4e9f-9379-fa074bf8ab7c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:00.013971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02572c1-39f5-45a3-8ba2-8952d4b49dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:00.014590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02572c1-39f5-45a3-8ba2-8952d4b49dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:00.014866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02572c1-39f5-45a3-8ba2-8952d4b49dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:00.015133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02572c1-39f5-45a3-8ba2-8952d4b49dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:00.015779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02572c1-39f5-45a3-8ba2-8952d4b49dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:00.017388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02572c1-39f5-45a3-8ba2-8952d4b49dc2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:00.028616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1025/2051] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:00.033117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b512-df20-4b7c-a5aa-0298e90263b2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:00.043976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7839b512-df20-4b7c-a5aa-0298e90263b2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:00.049053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc656f0-7f4e-4384-b3c8-87104a9030d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:00.049701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc656f0-7f4e-4384-b3c8-87104a9030d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:00.050018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc656f0-7f4e-4384-b3c8-87104a9030d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:00.050283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc656f0-7f4e-4384-b3c8-87104a9030d6 admin admin] PATH_INFO: `/v3/projects/04473be9237f4c829d6c32ee013ebb5b/users/2e35b1e311d04d22a7578c30a658c14b/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:00.052368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc656f0-7f4e-4384-b3c8-87104a9030d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04473be9237f4c829d6c32ee013ebb5b, user_id=2e35b1e311d04d22a7578c30a658c14b, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:00.055297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc656f0-7f4e-4384-b3c8-87104a9030d6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:00.070461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1027/2052] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:00 2022] PUT /identity/v3/projects/04473be9237f4c829d6c32ee013ebb5b/users/2e35b1e311d04d22a7578c30a658c14b/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:00.081773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331c5f-e0bd-4216-8687-b7839a728fb5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:00.082157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331c5f-e0bd-4216-8687-b7839a728fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:00.082434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331c5f-e0bd-4216-8687-b7839a728fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:00.110830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-58331c5f-e0bd-4216-8687-b7839a728fb5 None None] MFA Rules not processed for user `2e35b1e311d04d22a7578c30a658c14b`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:00.112092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-58331c5f-e0bd-4216-8687-b7839a728fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:00.186548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1026/2053] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:00 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:00.197047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc656f0-7f4e-4384-b3c8-87104a9030d6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:00.254313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc656f0-7f4e-4384-b3c8-87104a9030d6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:00.257972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:00.258587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:00.258861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:00.259130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:00.268120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:00.269589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:00.279689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1028/2054] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:00 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:00.362654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331c5f-e0bd-4216-8687-b7839a728fb5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:00.374794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331c5f-e0bd-4216-8687-b7839a728fb5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:00.380313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9df3-99c4-4821-9793-80666bc1859c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:00.381435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9df3-99c4-4821-9793-80666bc1859c service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:00.382484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9df3-99c4-4821-9793-80666bc1859c service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:00.386384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f9df3-99c4-4821-9793-80666bc1859c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:00.470473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f9df3-99c4-4821-9793-80666bc1859c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:00.478059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f9df3-99c4-4821-9793-80666bc1859c service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:00.485001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1027/2055] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:00 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:02.934470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:02.936099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:03.011377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:03.046170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f31072-ff61-45d6-8c47-83c116942ac9 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:03.058544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:03.059303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:03.059777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:03.060061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] PATH_INFO: `/v3/users/5bbcd6cb5081421382cae22c542db8f0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:03.061258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bbcd6cb5081421382cae22c542db8f0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:03.064487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:03.129350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9df3-99c4-4821-9793-80666bc1859c service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:03.137955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bbcd6cb5081421382cae22c542db8f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:03.138943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bbcd6cb5081421382cae22c542db8f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:03.139926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f9df3-99c4-4821-9793-80666bc1859c service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:03.145271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:03.146034 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:03.146319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:03.146593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:03.150151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:03.152376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bbcd6cb5081421382cae22c542db8f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:03.162708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bbcd6cb5081421382cae22c542db8f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:03.163715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:03.164276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1f692e57-c8bc-451b-a444-5787eb1b13b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bbcd6cb5081421382cae22c542db8f0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:03.198611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1029/2056] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:02 2022] DELETE /identity/v3/users/5bbcd6cb5081421382cae22c542db8f0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:03.207825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4edc47-cf28-49c7-8afb-10aa2f4cb61c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:03.208041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4edc47-cf28-49c7-8afb-10aa2f4cb61c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:03.208293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4edc47-cf28-49c7-8afb-10aa2f4cb61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:03.264197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6a4edc47-cf28-49c7-8afb-10aa2f4cb61c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:03.265427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6a4edc47-cf28-49c7-8afb-10aa2f4cb61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:03.268779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:03.270508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:03.282160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1028/2057] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:03 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:03.368331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1030/2058] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:03.381934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:03.383786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:03.536944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61d2ee-1991-4984-b542-4c3060ff17fd service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:03.620113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743df8b-f896-4bf7-9827-80b005154be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:03.620947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743df8b-f896-4bf7-9827-80b005154be1 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:03.621293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743df8b-f896-4bf7-9827-80b005154be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:03.621582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4743df8b-f896-4bf7-9827-80b005154be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:03.634039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743df8b-f896-4bf7-9827-80b005154be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:03.638566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4743df8b-f896-4bf7-9827-80b005154be1 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:03.677952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1029/2059] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:03.996404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4edc47-cf28-49c7-8afb-10aa2f4cb61c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:03.998037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6a4edc47-cf28-49c7-8afb-10aa2f4cb61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:04.012708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4edc47-cf28-49c7-8afb-10aa2f4cb61c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:04.019155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:04.020189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:04.020467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:04.020739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] PATH_INFO: `/v3/projects/c0dceb73e5654849ad03cae50109f497` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:04.022022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0dceb73e5654849ad03cae50109f497)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:04.024185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:04.076606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0dceb73e5654849ad03cae50109f497', 'request_id': 'req-9e1b0d35-4990-482e-93c7-ed20cc8daa71'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.081953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:04.083496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0dceb73e5654849ad03cae50109f497', 'request_id': 'req-9e1b0d35-4990-482e-93c7-ed20cc8daa71'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.090315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0dceb73e5654849ad03cae50109f497', 'request_id': 'req-9e1b0d35-4990-482e-93c7-ed20cc8daa71'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.104526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] The token cache is being invalidate because project c0dceb73e5654849ad03cae50109f497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:04.105241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.106002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.107595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1031/2060] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:03 2022] DELETE /identity/v3/projects/c0dceb73e5654849ad03cae50109f497 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:04.111848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743df8b-f896-4bf7-9827-80b005154be1 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:04.123025 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4743df8b-f896-4bf7-9827-80b005154be1 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:04.186708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:04.187458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:04.187627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:04.187861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] PATH_INFO: `/v3/users/e28afbd0bf22482aaef5c904ae102263` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:04.188993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28afbd0bf22482aaef5c904ae102263)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:04.191238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:04.196878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:04.241864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28afbd0bf22482aaef5c904ae102263'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.242622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28afbd0bf22482aaef5c904ae102263'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.254658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28afbd0bf22482aaef5c904ae102263'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.268910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28afbd0bf22482aaef5c904ae102263'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.269619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-aeab1f88-55fa-4cbf-b81b-48f6a9402303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28afbd0bf22482aaef5c904ae102263'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.284823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1030/2061] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:04 2022] DELETE /identity/v3/users/e28afbd0bf22482aaef5c904ae102263 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:04.578910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:04.580398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:04.593801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b0d35-4990-482e-93c7-ed20cc8daa71 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:04.657979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:04.658630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:04.659030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:04.659310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] PATH_INFO: `/v3/projects/76be63075ada45d0a8642d6ef417d4e5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:04.661421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=76be63075ada45d0a8642d6ef417d4e5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:04.663890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:04.728958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76be63075ada45d0a8642d6ef417d4e5', 'request_id': 'req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.750321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76be63075ada45d0a8642d6ef417d4e5', 'request_id': 'req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.770737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76be63075ada45d0a8642d6ef417d4e5', 'request_id': 'req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.798286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] The token cache is being invalidate because project 76be63075ada45d0a8642d6ef417d4e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:04.798531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.799363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:04.800849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1032/2062] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:04 2022] DELETE /identity/v3/projects/76be63075ada45d0a8642d6ef417d4e5 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:04.806611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002cc72-2e71-4e0d-b0b9-a762cb2ee32f None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:04.806611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002cc72-2e71-4e0d-b0b9-a762cb2ee32f None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:04.806611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002cc72-2e71-4e0d-b0b9-a762cb2ee32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:04.842864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2002cc72-2e71-4e0d-b0b9-a762cb2ee32f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:04.844295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2002cc72-2e71-4e0d-b0b9-a762cb2ee32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:04.924262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:04.926663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:04.969279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1031/2063] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:04.983564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46035667-72cc-4377-9876-b7f2f46fef86 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:04.983859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46035667-72cc-4377-9876-b7f2f46fef86 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:04.984135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46035667-72cc-4377-9876-b7f2f46fef86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.019695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-46035667-72cc-4377-9876-b7f2f46fef86 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:05.020272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-46035667-72cc-4377-9876-b7f2f46fef86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:05.034125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1032/2064] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:05.037051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46035667-72cc-4377-9876-b7f2f46fef86 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.044943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ab52fe-91e8-4914-9199-f3ef0084ad5c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.048810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46035667-72cc-4377-9876-b7f2f46fef86 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.052804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.054597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.055299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.055299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] PATH_INFO: `/v3/users/f67838f82a9d413f8ab1fb0242c81a4b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.057207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67838f82a9d413f8ab1fb0242c81a4b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.058512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.059324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.059783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.060094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.060373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.061073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:05.061563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.063593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.079892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1033/2065] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:05.081418 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.082072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:05.101150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44552e0b-ed4b-4265-a923-e1bc3fd964c0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.111802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf92a66-9d32-4150-9fc4-a0558b790623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.112668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf92a66-9d32-4150-9fc4-a0558b790623 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.113121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf92a66-9d32-4150-9fc4-a0558b790623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.113573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf92a66-9d32-4150-9fc4-a0558b790623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.114847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf92a66-9d32-4150-9fc4-a0558b790623 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.117247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf92a66-9d32-4150-9fc4-a0558b790623 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.144509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67838f82a9d413f8ab1fb0242c81a4b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.145343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67838f82a9d413f8ab1fb0242c81a4b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.155317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1034/2066] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:05 2022] POST /identity/v3/projects => generated 389 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:05.159147 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67838f82a9d413f8ab1fb0242c81a4b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.159506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf92a66-9d32-4150-9fc4-a0558b790623 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.168974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67838f82a9d413f8ab1fb0242c81a4b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.169872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-176dcfa6-29fb-4e33-aea7-c712072c55c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67838f82a9d413f8ab1fb0242c81a4b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.198467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1033/2067] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:04 2022] DELETE /identity/v3/users/f67838f82a9d413f8ab1fb0242c81a4b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:05.203358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee54fc-65ea-4b82-9dcb-d5c946bf63c5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.203869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee54fc-65ea-4b82-9dcb-d5c946bf63c5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.204443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee54fc-65ea-4b82-9dcb-d5c946bf63c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.215485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:05.240024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0fee54fc-65ea-4b82-9dcb-d5c946bf63c5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:05.242264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0fee54fc-65ea-4b82-9dcb-d5c946bf63c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:05.245922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf92a66-9d32-4150-9fc4-a0558b790623 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.309847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1034/2068] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:05.316853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.317438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.317886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.318159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.318848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.318959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee54fc-65ea-4b82-9dcb-d5c946bf63c5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.320311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0fee54fc-65ea-4b82-9dcb-d5c946bf63c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:05.321145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.343798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1035/2069] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:05 2022] POST /identity/v3/users => generated 295 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:05.347685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.349489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:05.362334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcbdc8c-e458-4396-96da-425bc93ee9d5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.370013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8c60-a887-4430-9fe1-8084f94a1e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.370765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8c60-a887-4430-9fe1-8084f94a1e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.371108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8c60-a887-4430-9fe1-8084f94a1e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.371442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f8c60-a887-4430-9fe1-8084f94a1e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.372159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f8c60-a887-4430-9fe1-8084f94a1e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.374234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f8c60-a887-4430-9fe1-8084f94a1e29 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.382400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee54fc-65ea-4b82-9dcb-d5c946bf63c5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.387769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1036/2070] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:05.388394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1eec-8ac3-4cb4-88fc-491973aff14e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.389050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1eec-8ac3-4cb4-88fc-491973aff14e service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.389467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1eec-8ac3-4cb4-88fc-491973aff14e service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.389766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea1eec-8ac3-4cb4-88fc-491973aff14e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.391787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8c60-a887-4430-9fe1-8084f94a1e29 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.401489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea1eec-8ac3-4cb4-88fc-491973aff14e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.403714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea1eec-8ac3-4cb4-88fc-491973aff14e service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.407790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f8c60-a887-4430-9fe1-8084f94a1e29 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.414136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3a7a1-88a6-4b06-a2b6-695298b0c6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.414915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3a7a1-88a6-4b06-a2b6-695298b0c6fd admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.415068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3a7a1-88a6-4b06-a2b6-695298b0c6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.415398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3a7a1-88a6-4b06-a2b6-695298b0c6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.416165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3a7a1-88a6-4b06-a2b6-695298b0c6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.418032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3a7a1-88a6-4b06-a2b6-695298b0c6fd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.425074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1035/2071] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:05.433577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1037/2072] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:05.435233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1eec-8ac3-4cb4-88fc-491973aff14e service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.445813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea1eec-8ac3-4cb4-88fc-491973aff14e service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.451431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de255704-fc41-4f3f-bfee-1e3895dde5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.452103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de255704-fc41-4f3f-bfee-1e3895dde5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.452395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de255704-fc41-4f3f-bfee-1e3895dde5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.452653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de255704-fc41-4f3f-bfee-1e3895dde5c7 admin admin] PATH_INFO: `/v3/projects/149495d7f7c14f598c7e71f4acf2c35c/users/a0e4f502290f4d54ac7b79e59f05a40f/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.469823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de255704-fc41-4f3f-bfee-1e3895dde5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149495d7f7c14f598c7e71f4acf2c35c, user_id=a0e4f502290f4d54ac7b79e59f05a40f, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.472537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de255704-fc41-4f3f-bfee-1e3895dde5c7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.487724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1036/2073] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:05 2022] PUT /identity/v3/projects/149495d7f7c14f598c7e71f4acf2c35c/users/a0e4f502290f4d54ac7b79e59f05a40f/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:05.501794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2707a-11eb-4233-a554-c38a92ac45c7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.502107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2707a-11eb-4233-a554-c38a92ac45c7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.502343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d2707a-11eb-4233-a554-c38a92ac45c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.543935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e1d2707a-11eb-4233-a554-c38a92ac45c7 None None] MFA Rules not processed for user `a0e4f502290f4d54ac7b79e59f05a40f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:05.546186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e1d2707a-11eb-4233-a554-c38a92ac45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:05.618951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1038/2074] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:05.623646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de255704-fc41-4f3f-bfee-1e3895dde5c7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.639289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:05.703204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de255704-fc41-4f3f-bfee-1e3895dde5c7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.708796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa56a9-348d-4fcb-9555-0b5867bc00eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.709449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa56a9-348d-4fcb-9555-0b5867bc00eb admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.709727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa56a9-348d-4fcb-9555-0b5867bc00eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.710021 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa56a9-348d-4fcb-9555-0b5867bc00eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.710728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa56a9-348d-4fcb-9555-0b5867bc00eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.712968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa56a9-348d-4fcb-9555-0b5867bc00eb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.752679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2707a-11eb-4233-a554-c38a92ac45c7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.754211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e1d2707a-11eb-4233-a554-c38a92ac45c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:05.771237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1037/2075] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:05 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:05.773914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d2707a-11eb-4233-a554-c38a92ac45c7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.775196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa56a9-348d-4fcb-9555-0b5867bc00eb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.847611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:05.868031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.868804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.869086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.869359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] PATH_INFO: `/v3/projects/2edc85cd7e5b4a33967ec5088e8d45f7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.870644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2edc85cd7e5b4a33967ec5088e8d45f7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.870748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa56a9-348d-4fcb-9555-0b5867bc00eb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.872715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.875957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27749ced-ef9d-422a-bdff-37e703aac9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.877149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749ced-ef9d-422a-bdff-37e703aac9bd admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.877429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749ced-ef9d-422a-bdff-37e703aac9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.877745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27749ced-ef9d-422a-bdff-37e703aac9bd admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:05.879093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27749ced-ef9d-422a-bdff-37e703aac9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:05.882581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27749ced-ef9d-422a-bdff-37e703aac9bd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:05.908640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1038/2076] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:05 2022] POST /identity/v3/users => generated 300 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:05.912464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27749ced-ef9d-422a-bdff-37e703aac9bd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.926944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27749ced-ef9d-422a-bdff-37e703aac9bd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:05.950022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2edc85cd7e5b4a33967ec5088e8d45f7', 'request_id': 'req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.950022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2edc85cd7e5b4a33967ec5088e8d45f7', 'request_id': 'req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.959116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2edc85cd7e5b4a33967ec5088e8d45f7', 'request_id': 'req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.973628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] The token cache is being invalidate because project 2edc85cd7e5b4a33967ec5088e8d45f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:05.974132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.974808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:05.981774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1039/2077] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:05 2022] DELETE /identity/v3/projects/2edc85cd7e5b4a33967ec5088e8d45f7 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:05.981774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:05.982852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:05.998178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:05.998919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:05.999293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:05.999944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.000363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.002424 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.017908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1039/2078] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:06.019368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:06.021295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.034001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811211f-c5df-4222-a6d5-36e3905fc279 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.039313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b085f-fe1d-486c-99c8-9318458b4d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.039982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b085f-fe1d-486c-99c8-9318458b4d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.040258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b085f-fe1d-486c-99c8-9318458b4d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.040534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b085f-fe1d-486c-99c8-9318458b4d78 admin admin] PATH_INFO: `/v3/projects/abab3e4a034e41d9bad44bcd8c78eb73/users/1aee835e76d0436081215c52b92f6904/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.059411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b085f-fe1d-486c-99c8-9318458b4d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abab3e4a034e41d9bad44bcd8c78eb73, user_id=1aee835e76d0436081215c52b92f6904, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.061290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e4e83-9ce5-4f81-a83a-7b3f8d7d4398 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.062178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b085f-fe1d-486c-99c8-9318458b4d78 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.066096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.066893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.067057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.067454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] PATH_INFO: `/v3/users/2e35b1e311d04d22a7578c30a658c14b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.068784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e35b1e311d04d22a7578c30a658c14b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.070753 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.076234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:06.081159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1040/2079] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:06 2022] PUT /identity/v3/projects/abab3e4a034e41d9bad44bcd8c78eb73/users/1aee835e76d0436081215c52b92f6904/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:06.085157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b085f-fe1d-486c-99c8-9318458b4d78 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:06.126054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e35b1e311d04d22a7578c30a658c14b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.127229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e35b1e311d04d22a7578c30a658c14b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.136634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e35b1e311d04d22a7578c30a658c14b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.151774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e35b1e311d04d22a7578c30a658c14b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.152607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e35b1e311d04d22a7578c30a658c14b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.159249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:06.176762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1040/2080] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:05 2022] DELETE /identity/v3/users/2e35b1e311d04d22a7578c30a658c14b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:06.184144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b085f-fe1d-486c-99c8-9318458b4d78 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.254082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd655a2b-4509-499a-a9bb-e74b1af04d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.254082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655a2b-4509-499a-a9bb-e74b1af04d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.254307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655a2b-4509-499a-a9bb-e74b1af04d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.254814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd655a2b-4509-499a-a9bb-e74b1af04d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.255084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd655a2b-4509-499a-a9bb-e74b1af04d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.256708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd655a2b-4509-499a-a9bb-e74b1af04d5e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.273780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1041/2081] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:06.279944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:06.281704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.315789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2b47f-44b4-4c31-a82b-963c9cb0ef92 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.316412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.317139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.317486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.317941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] PATH_INFO: `/v3/projects/abab3e4a034e41d9bad44bcd8c78eb73/users/1aee835e76d0436081215c52b92f6904/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.320496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abab3e4a034e41d9bad44bcd8c78eb73, user_id=1aee835e76d0436081215c52b92f6904, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.323470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.337673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1041/2082] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:06 2022] PUT /identity/v3/projects/abab3e4a034e41d9bad44bcd8c78eb73/users/1aee835e76d0436081215c52b92f6904/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:06.348400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a31c92-cc07-47c7-850e-089ec0e858d4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.348619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a31c92-cc07-47c7-850e-089ec0e858d4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.348872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a31c92-cc07-47c7-850e-089ec0e858d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.384001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-70a31c92-cc07-47c7-850e-089ec0e858d4 None None] MFA Rules not processed for user `1aee835e76d0436081215c52b92f6904`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:06.385405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-70a31c92-cc07-47c7-850e-089ec0e858d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.469578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1042/2083] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:06.481264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:06.483517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.526201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a31c92-cc07-47c7-850e-089ec0e858d4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:06.528241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-70a31c92-cc07-47c7-850e-089ec0e858d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.556892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9a672-39f1-4b64-ad62-a8bf230411c8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.561844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac5c5d-ca3c-46e5-8d7d-8827192e4fff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.562541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac5c5d-ca3c-46e5-8d7d-8827192e4fff service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.562882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac5c5d-ca3c-46e5-8d7d-8827192e4fff service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.563208 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac5c5d-ca3c-46e5-8d7d-8827192e4fff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.572117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:06.575457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac5c5d-ca3c-46e5-8d7d-8827192e4fff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.576953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ac5c5d-ca3c-46e5-8d7d-8827192e4fff service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.587893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1042/2084] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:06 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:06.614260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a31c92-cc07-47c7-850e-089ec0e858d4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.620571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.621567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.621567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.621878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] PATH_INFO: `/v3/projects/04473be9237f4c829d6c32ee013ebb5b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.623017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=04473be9237f4c829d6c32ee013ebb5b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.625183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.694023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04473be9237f4c829d6c32ee013ebb5b', 'request_id': 'req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.699585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04473be9237f4c829d6c32ee013ebb5b', 'request_id': 'req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.706527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04473be9237f4c829d6c32ee013ebb5b', 'request_id': 'req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.722523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] The token cache is being invalidate because project 04473be9237f4c829d6c32ee013ebb5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:06.722828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.723470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.729181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1043/2085] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:06 2022] DELETE /identity/v3/projects/04473be9237f4c829d6c32ee013ebb5b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:06.730853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8995f2-49a6-42fc-9b71-642563ca5295 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.731134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8995f2-49a6-42fc-9b71-642563ca5295 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.731405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8995f2-49a6-42fc-9b71-642563ca5295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.748386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:06.749790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.753936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9e8995f2-49a6-42fc-9b71-642563ca5295 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:06.755203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9e8995f2-49a6-42fc-9b71-642563ca5295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.820189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1043/2086] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:06.826314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80507ca1-25f1-4e33-b4d3-54c04f9edb4d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.828680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75915-7365-4ea2-879b-1faf84275e9d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.828990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75915-7365-4ea2-879b-1faf84275e9d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.829310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75915-7365-4ea2-879b-1faf84275e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.834038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.834801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.835147 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.835559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] PATH_INFO: `/v3/users/a0e4f502290f4d54ac7b79e59f05a40f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.836819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0e4f502290f4d54ac7b79e59f05a40f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.838912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.851829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-76d75915-7365-4ea2-879b-1faf84275e9d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:06.853578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-76d75915-7365-4ea2-879b-1faf84275e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.864201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1044/2087] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:06.868772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75915-7365-4ea2-879b-1faf84275e9d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:06.880141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75915-7365-4ea2-879b-1faf84275e9d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.895809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.896740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.897166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.897610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.898502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:06.899918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.902445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.908285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0e4f502290f4d54ac7b79e59f05a40f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.908969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0e4f502290f4d54ac7b79e59f05a40f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.918902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0e4f502290f4d54ac7b79e59f05a40f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.919395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1045/2088] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:38:06.923624 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:06.928665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:06.931876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0e4f502290f4d54ac7b79e59f05a40f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.932715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6bd1f57-a078-4d96-a554-075a4b8e813b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0e4f502290f4d54ac7b79e59f05a40f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:06.936888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4ed82-bb9d-4dab-a784-892822453925 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:06.944893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:06.945797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.946165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.946536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.947249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:06.949282 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:06.955187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1044/2089] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:06 2022] DELETE /identity/v3/users/a0e4f502290f4d54ac7b79e59f05a40f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:06.959328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1c66-4141-4003-8ada-1237817eaf85 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:06.959680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1c66-4141-4003-8ada-1237817eaf85 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:06.960014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1c66-4141-4003-8ada-1237817eaf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:06.981904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6d2d1c66-4141-4003-8ada-1237817eaf85 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:06.983496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6d2d1c66-4141-4003-8ada-1237817eaf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:06.994957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1046/2090] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:06 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:06.998504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.000675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:07.056668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:07.066429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1045/2091] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:07.074457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1c66-4141-4003-8ada-1237817eaf85 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.076203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6d2d1c66-4141-4003-8ada-1237817eaf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:07.080730 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b19c2-e010-4462-add2-78fce8817fd2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.086756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0df73-37ef-4417-b984-841958083cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.088335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0df73-37ef-4417-b984-841958083cf6 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.088717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0df73-37ef-4417-b984-841958083cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.089638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0df73-37ef-4417-b984-841958083cf6 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.090724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0df73-37ef-4417-b984-841958083cf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.092953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0df73-37ef-4417-b984-841958083cf6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.119885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1047/2092] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:06 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:38:07.124919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0df73-37ef-4417-b984-841958083cf6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.138722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0df73-37ef-4417-b984-841958083cf6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.138948 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1c66-4141-4003-8ada-1237817eaf85 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.145160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47103812-4062-4bfb-8236-d0f852b6aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.145968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103812-4062-4bfb-8236-d0f852b6aaa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.146530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103812-4062-4bfb-8236-d0f852b6aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.147187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47103812-4062-4bfb-8236-d0f852b6aaa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.148554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47103812-4062-4bfb-8236-d0f852b6aaa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.150933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47103812-4062-4bfb-8236-d0f852b6aaa1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.165200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1048/2093] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:07.166276 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47103812-4062-4bfb-8236-d0f852b6aaa1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.179028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47103812-4062-4bfb-8236-d0f852b6aaa1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.186447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef706f7e-fc86-4d27-9c94-334bd6a2afec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.187820 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef706f7e-fc86-4d27-9c94-334bd6a2afec admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.188332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef706f7e-fc86-4d27-9c94-334bd6a2afec admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.189958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef706f7e-fc86-4d27-9c94-334bd6a2afec admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.191017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef706f7e-fc86-4d27-9c94-334bd6a2afec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.193882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef706f7e-fc86-4d27-9c94-334bd6a2afec admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.199629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a62886-8dc6-413d-a0ca-5fa25d830213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.200587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62886-8dc6-413d-a0ca-5fa25d830213 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.200924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62886-8dc6-413d-a0ca-5fa25d830213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.201251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62886-8dc6-413d-a0ca-5fa25d830213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.212463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1049/2094] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:07.213711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a62886-8dc6-413d-a0ca-5fa25d830213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.213848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef706f7e-fc86-4d27-9c94-334bd6a2afec admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.215950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a62886-8dc6-413d-a0ca-5fa25d830213 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.225699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef706f7e-fc86-4d27-9c94-334bd6a2afec admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.228719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1046/2095] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:07.231098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166da57b-a777-4ed0-9a92-5b38de487423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.231764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166da57b-a777-4ed0-9a92-5b38de487423 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.232731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166da57b-a777-4ed0-9a92-5b38de487423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.233019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166da57b-a777-4ed0-9a92-5b38de487423 admin admin] PATH_INFO: `/v3/projects/7c842103c4b44e0f8cc1006d75b59c80/users/b5bb3fee16c04165b46bea9cdfd30017/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.249883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166da57b-a777-4ed0-9a92-5b38de487423 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c842103c4b44e0f8cc1006d75b59c80, user_id=b5bb3fee16c04165b46bea9cdfd30017, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.252965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166da57b-a777-4ed0-9a92-5b38de487423 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.267500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1050/2096] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:07 2022] PUT /identity/v3/projects/7c842103c4b44e0f8cc1006d75b59c80/users/b5bb3fee16c04165b46bea9cdfd30017/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:07.279182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d832d8-65cf-4b9c-8aaa-16aa0d457553 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.283440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d832d8-65cf-4b9c-8aaa-16aa0d457553 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.283834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d832d8-65cf-4b9c-8aaa-16aa0d457553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.338635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-19d832d8-65cf-4b9c-8aaa-16aa0d457553 None None] MFA Rules not processed for user `b5bb3fee16c04165b46bea9cdfd30017`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:07.340300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-19d832d8-65cf-4b9c-8aaa-16aa0d457553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:07.395063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:07.470648 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1047/2097] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:07.476419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166da57b-a777-4ed0-9a92-5b38de487423 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.592127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166da57b-a777-4ed0-9a92-5b38de487423 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.597367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.598035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.598301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.598570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.599268 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.601178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.635690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1051/2098] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:07 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:07.640163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d832d8-65cf-4b9c-8aaa-16aa0d457553 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.646899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.649132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:07.652763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d832d8-65cf-4b9c-8aaa-16aa0d457553 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.723582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9b7eb-37ae-4413-b2da-16af4b5f4187 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.728036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4fb1b-b661-4255-882e-1dba53aa8543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.729273 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4fb1b-b661-4255-882e-1dba53aa8543 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.729273 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4fb1b-b661-4255-882e-1dba53aa8543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.729646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4fb1b-b661-4255-882e-1dba53aa8543 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.730247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.730560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4fb1b-b661-4255-882e-1dba53aa8543 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.731193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.731522 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.731901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] PATH_INFO: `/v3/projects/149495d7f7c14f598c7e71f4acf2c35c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.733132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149495d7f7c14f598c7e71f4acf2c35c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.733242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4fb1b-b661-4255-882e-1dba53aa8543 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.735362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.764176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1048/2099] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:07 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:07.767930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4fb1b-b661-4255-882e-1dba53aa8543 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.772133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:07.794482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4fb1b-b661-4255-882e-1dba53aa8543 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.800164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0d149-5c18-4215-b5e5-e50039a26607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.800795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0d149-5c18-4215-b5e5-e50039a26607 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.801084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0d149-5c18-4215-b5e5-e50039a26607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.801361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea0d149-5c18-4215-b5e5-e50039a26607 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.802094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0d149-5c18-4215-b5e5-e50039a26607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.804268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea0d149-5c18-4215-b5e5-e50039a26607 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.815640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1049/2100] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:07.819981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0d149-5c18-4215-b5e5-e50039a26607 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.820991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149495d7f7c14f598c7e71f4acf2c35c', 'request_id': 'req-8413021e-687e-4422-b4db-42de86769c60'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:07.829255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149495d7f7c14f598c7e71f4acf2c35c', 'request_id': 'req-8413021e-687e-4422-b4db-42de86769c60'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:07.831821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea0d149-5c18-4215-b5e5-e50039a26607 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.839839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149495d7f7c14f598c7e71f4acf2c35c', 'request_id': 'req-8413021e-687e-4422-b4db-42de86769c60'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:07.853197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] The token cache is being invalidate because project 149495d7f7c14f598c7e71f4acf2c35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:07.853852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:07.855497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:07.860528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1052/2101] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:07 2022] DELETE /identity/v3/projects/149495d7f7c14f598c7e71f4acf2c35c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:07.861506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.863110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:07.899318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.899851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.900130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.900409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.901060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.902775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.921851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1050/2102] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:07.926330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:07.928533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:07.944845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eae287-0597-4a8d-a2e6-e532b48d1261 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.949666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a9525-2578-444f-bd58-14e6bff8effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.950370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9525-2578-444f-bd58-14e6bff8effa admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.950652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9525-2578-444f-bd58-14e6bff8effa admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.950927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a9525-2578-444f-bd58-14e6bff8effa admin admin] PATH_INFO: `/v3/projects/acd2e7a72dce4d30a072cab140b4801a/users/27da5f25d9f942a4819b2a2c181361b7/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.969780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413021e-687e-4422-b4db-42de86769c60 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:07.969780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:07.969780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:07.969780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:07.970279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] PATH_INFO: `/v3/users/1aee835e76d0436081215c52b92f6904` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:07.970279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aee835e76d0436081215c52b92f6904)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.970416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.972421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a9525-2578-444f-bd58-14e6bff8effa admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd2e7a72dce4d30a072cab140b4801a, user_id=27da5f25d9f942a4819b2a2c181361b7, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:07.974887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a9525-2578-444f-bd58-14e6bff8effa admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:07.995126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1051/2103] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:07 2022] PUT /identity/v3/projects/acd2e7a72dce4d30a072cab140b4801a/users/27da5f25d9f942a4819b2a2c181361b7/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:08.008056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2387-3dcb-410e-848e-9a3cb35c8f5e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.008385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2387-3dcb-410e-848e-9a3cb35c8f5e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.008670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d2387-3dcb-410e-848e-9a3cb35c8f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.039467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aee835e76d0436081215c52b92f6904'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.040359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aee835e76d0436081215c52b92f6904'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.043172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8f6d2387-3dcb-410e-848e-9a3cb35c8f5e None None] MFA Rules not processed for user `27da5f25d9f942a4819b2a2c181361b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:08.044500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8f6d2387-3dcb-410e-848e-9a3cb35c8f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.050282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:08.050669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aee835e76d0436081215c52b92f6904'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.066962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aee835e76d0436081215c52b92f6904'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.067814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aee835e76d0436081215c52b92f6904'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.083037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1053/2104] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:07 2022] DELETE /identity/v3/users/1aee835e76d0436081215c52b92f6904 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:08.131350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1052/2105] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:08.135084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.136879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.176018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:08.232672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71664078-d28a-46ad-9e9d-c610eaff1497 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.237383 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.237892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.238184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.238416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.239058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.240973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.277800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1054/2106] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:08 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:08.282109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d2387-3dcb-410e-848e-9a3cb35c8f5e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.396698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d2387-3dcb-410e-848e-9a3cb35c8f5e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.397241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.399300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.472984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ea56c-e1cd-4924-a62b-404a3919d8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.473803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ea56c-e1cd-4924-a62b-404a3919d8ec admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.474185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ea56c-e1cd-4924-a62b-404a3919d8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.475231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ea56c-e1cd-4924-a62b-404a3919d8ec admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.475231 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ea56c-e1cd-4924-a62b-404a3919d8ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.478465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ea56c-e1cd-4924-a62b-404a3919d8ec admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.497784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b5c1f-9c73-4fb9-9dcf-585ceed99619 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.502702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1053/2107] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:08 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:08.504547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.505315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.505452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.505807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] PATH_INFO: `/v3/projects/abab3e4a034e41d9bad44bcd8c78eb73` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.506867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=abab3e4a034e41d9bad44bcd8c78eb73)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.507332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ea56c-e1cd-4924-a62b-404a3919d8ec admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.509030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.518395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ea56c-e1cd-4924-a62b-404a3919d8ec admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.523279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b39b2-b257-4388-81a6-114e6d799613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.523887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b39b2-b257-4388-81a6-114e6d799613 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.524164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b39b2-b257-4388-81a6-114e6d799613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.524436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b39b2-b257-4388-81a6-114e6d799613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.525113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b39b2-b257-4388-81a6-114e6d799613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.526770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b39b2-b257-4388-81a6-114e6d799613 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.537370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1054/2108] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:08.541999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b39b2-b257-4388-81a6-114e6d799613 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.554468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b39b2-b257-4388-81a6-114e6d799613 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.569304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abab3e4a034e41d9bad44bcd8c78eb73', 'request_id': 'req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.576104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abab3e4a034e41d9bad44bcd8c78eb73', 'request_id': 'req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.590213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abab3e4a034e41d9bad44bcd8c78eb73', 'request_id': 'req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.591794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:08.605086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] The token cache is being invalidate because project abab3e4a034e41d9bad44bcd8c78eb73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:08.605378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.606099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7703dc06-8a72-485d-a3b2-c9c31b8c7f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.608052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1055/2109] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:08 2022] DELETE /identity/v3/projects/abab3e4a034e41d9bad44bcd8c78eb73 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:08.614666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e50c-c602-4407-81e9-e225fbc72531 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.615532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e50c-c602-4407-81e9-e225fbc72531 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.615895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514e50c-c602-4407-81e9-e225fbc72531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.629195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bde4b-dc2a-4714-9359-03913058b425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.629913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bde4b-dc2a-4714-9359-03913058b425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.630194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bde4b-dc2a-4714-9359-03913058b425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.630465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bde4b-dc2a-4714-9359-03913058b425 admin admin] PATH_INFO: `/v3/projects/b43aa52d33424f9cb81e7542b448a994/users/f2a279c72b2041c0afef882da0840f8a/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.640356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f514e50c-c602-4407-81e9-e225fbc72531 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:08.641603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f514e50c-c602-4407-81e9-e225fbc72531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.646476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bde4b-dc2a-4714-9359-03913058b425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43aa52d33424f9cb81e7542b448a994, user_id=f2a279c72b2041c0afef882da0840f8a, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.649321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bde4b-dc2a-4714-9359-03913058b425 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.650643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1056/2110] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:08.651374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514e50c-c602-4407-81e9-e225fbc72531 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.656602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f514e50c-c602-4407-81e9-e225fbc72531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.669389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514e50c-c602-4407-81e9-e225fbc72531 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.669861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1055/2111] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:08 2022] PUT /identity/v3/projects/b43aa52d33424f9cb81e7542b448a994/users/f2a279c72b2041c0afef882da0840f8a/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:08.672000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd255b9-161c-474d-97b4-45fe1e66c52e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.672478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd255b9-161c-474d-97b4-45fe1e66c52e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.673500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd255b9-161c-474d-97b4-45fe1e66c52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.696848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7cd255b9-161c-474d-97b4-45fe1e66c52e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:08.698500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7cd255b9-161c-474d-97b4-45fe1e66c52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.703172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:08.738869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.739514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.739871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.740384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] PATH_INFO: `/v3/users/fd5b31e7fc1d4eed893fd69661b35ee7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.741657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd5b31e7fc1d4eed893fd69661b35ee7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.744459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.776880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1056/2112] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:08.778134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd255b9-161c-474d-97b4-45fe1e66c52e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.780079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7cd255b9-161c-474d-97b4-45fe1e66c52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.792547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd255b9-161c-474d-97b4-45fe1e66c52e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.797370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a800a4-8480-4a1f-b3e8-32dfa29d3efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.798110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a800a4-8480-4a1f-b3e8-32dfa29d3efe admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.798459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a800a4-8480-4a1f-b3e8-32dfa29d3efe admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.798800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a800a4-8480-4a1f-b3e8-32dfa29d3efe admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.799515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a800a4-8480-4a1f-b3e8-32dfa29d3efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.801306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a800a4-8480-4a1f-b3e8-32dfa29d3efe admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.808144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd5b31e7fc1d4eed893fd69661b35ee7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.809472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd5b31e7fc1d4eed893fd69661b35ee7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.811727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1057/2113] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:08.812574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a800a4-8480-4a1f-b3e8-32dfa29d3efe admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.822464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd5b31e7fc1d4eed893fd69661b35ee7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.823397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a800a4-8480-4a1f-b3e8-32dfa29d3efe admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.830164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.831000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.831428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.831792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.832867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:08.833267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.837053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.840932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd5b31e7fc1d4eed893fd69661b35ee7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.841835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd5b31e7fc1d4eed893fd69661b35ee7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:08.852276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1058/2114] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:08.853145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.858562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.861731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1057/2115] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:08 2022] DELETE /identity/v3/users/fd5b31e7fc1d4eed893fd69661b35ee7 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:08.862679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:08.864665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:08.877840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5678531-26f6-4898-9d0c-5eff1aa0711e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.945788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f34e9-e80f-4e6d-a286-0895c33f35c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.946487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f34e9-e80f-4e6d-a286-0895c33f35c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.946771 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f34e9-e80f-4e6d-a286-0895c33f35c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.947112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f34e9-e80f-4e6d-a286-0895c33f35c1 admin admin] PATH_INFO: `/v3/projects/b43aa52d33424f9cb81e7542b448a994/users/f2a279c72b2041c0afef882da0840f8a/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.947557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea963405-5fa6-4177-af23-4a91dc01fea8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:08.949133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f34e9-e80f-4e6d-a286-0895c33f35c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43aa52d33424f9cb81e7542b448a994, user_id=f2a279c72b2041c0afef882da0840f8a, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.952163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929f34e9-e80f-4e6d-a286-0895c33f35c1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.955064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7475e70-f080-4860-b694-2de4053e228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:08.955755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7475e70-f080-4860-b694-2de4053e228e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.956410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7475e70-f080-4860-b694-2de4053e228e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.956754 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7475e70-f080-4860-b694-2de4053e228e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:08.957789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7475e70-f080-4860-b694-2de4053e228e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:08.959833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7475e70-f080-4860-b694-2de4053e228e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:08.969142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1059/2116] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:08 2022] PUT /identity/v3/projects/b43aa52d33424f9cb81e7542b448a994/users/f2a279c72b2041c0afef882da0840f8a/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:08.980011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71885bcf-4ed1-4ed1-baad-b58a132a40cd None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:08.980011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71885bcf-4ed1-4ed1-baad-b58a132a40cd None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:08.980011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71885bcf-4ed1-4ed1-baad-b58a132a40cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.009428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1058/2117] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:08 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:09.010682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-71885bcf-4ed1-4ed1-baad-b58a132a40cd None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:09.012445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-71885bcf-4ed1-4ed1-baad-b58a132a40cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:09.012772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223cbe-a301-4ad8-b9f8-df62ccad1135 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.013064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223cbe-a301-4ad8-b9f8-df62ccad1135 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.013338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce223cbe-a301-4ad8-b9f8-df62ccad1135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.043823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:09.060421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ce223cbe-a301-4ad8-b9f8-df62ccad1135 None None] MFA Rules not processed for user `f2a279c72b2041c0afef882da0840f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:09.061662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce223cbe-a301-4ad8-b9f8-df62ccad1135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:09.090205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:09.127411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1060/2118] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:09.130942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71885bcf-4ed1-4ed1-baad-b58a132a40cd None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.140531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71885bcf-4ed1-4ed1-baad-b58a132a40cd None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.146967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707df09-19a1-4a89-887d-e4a4ee051558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.147937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707df09-19a1-4a89-887d-e4a4ee051558 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.148050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707df09-19a1-4a89-887d-e4a4ee051558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.148403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707df09-19a1-4a89-887d-e4a4ee051558 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.150074 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707df09-19a1-4a89-887d-e4a4ee051558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.151381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707df09-19a1-4a89-887d-e4a4ee051558 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.170728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1059/2119] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:09.171831 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223cbe-a301-4ad8-b9f8-df62ccad1135 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.173673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ce223cbe-a301-4ad8-b9f8-df62ccad1135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:09.186135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1061/2120] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:09 2022] POST /identity/v3/users => generated 287 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:09.187400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707df09-19a1-4a89-887d-e4a4ee051558 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.207538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707df09-19a1-4a89-887d-e4a4ee051558 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.215176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.215835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.216110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.216383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.217528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.219214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.236118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1062/2121] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:09.236118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.236118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:09.255809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce223cbe-a301-4ad8-b9f8-df62ccad1135 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.264633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254828a-628a-4e6e-9a51-e5e1fdabc618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.266164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254828a-628a-4e6e-9a51-e5e1fdabc618 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.266440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254828a-628a-4e6e-9a51-e5e1fdabc618 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.266709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254828a-628a-4e6e-9a51-e5e1fdabc618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.282082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254828a-628a-4e6e-9a51-e5e1fdabc618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.283743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254828a-628a-4e6e-9a51-e5e1fdabc618 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.296017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1060/2122] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:09.297986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254828a-628a-4e6e-9a51-e5e1fdabc618 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.307709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ebea71-30cf-4e64-aefa-e869c4f7e5c7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.308494 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254828a-628a-4e6e-9a51-e5e1fdabc618 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.312067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.312784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.313035 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b69fa-c9be-4a5f-8f6e-e29277a63fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.313246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.313598 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.313693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b69fa-c9be-4a5f-8f6e-e29277a63fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.313970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b69fa-c9be-4a5f-8f6e-e29277a63fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.314243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095b69fa-c9be-4a5f-8f6e-e29277a63fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.314881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b69fa-c9be-4a5f-8f6e-e29277a63fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.316499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095b69fa-c9be-4a5f-8f6e-e29277a63fd1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.323876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.325398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.327983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1061/2123] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:09.332023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b69fa-c9be-4a5f-8f6e-e29277a63fd1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.336006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1063/2124] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:09.349395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095b69fa-c9be-4a5f-8f6e-e29277a63fd1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.357991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f8339d-6368-4e57-8e90-8b894adc7954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.358870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8339d-6368-4e57-8e90-8b894adc7954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.359271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8339d-6368-4e57-8e90-8b894adc7954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.359649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f8339d-6368-4e57-8e90-8b894adc7954 admin admin] PATH_INFO: `/v3/projects/32faf3cb3f214d658ecbb55c291eee6d/users/f3c6d0837618423ea049934847caae07/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.383698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.383966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8339d-6368-4e57-8e90-8b894adc7954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32faf3cb3f214d658ecbb55c291eee6d, user_id=f3c6d0837618423ea049934847caae07, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.385289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:09.386783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f8339d-6368-4e57-8e90-8b894adc7954 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.404279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1062/2125] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:09 2022] PUT /identity/v3/projects/32faf3cb3f214d658ecbb55c291eee6d/users/f3c6d0837618423ea049934847caae07/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:09.414099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94157d86-b3a5-4ffe-ae05-c679fab80645 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.415792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702768b6-5884-4dc5-bd32-f44ff7483e55 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.416229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702768b6-5884-4dc5-bd32-f44ff7483e55 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.416658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702768b6-5884-4dc5-bd32-f44ff7483e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.459166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-702768b6-5884-4dc5-bd32-f44ff7483e55 None None] MFA Rules not processed for user `f3c6d0837618423ea049934847caae07`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:09.460405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-702768b6-5884-4dc5-bd32-f44ff7483e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:09.500618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.503155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.503620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.503895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.508061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:09.573908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1063/2126] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:09.588910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702768b6-5884-4dc5-bd32-f44ff7483e55 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.599985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:09.600838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702768b6-5884-4dc5-bd32-f44ff7483e55 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.603230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.604912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.606286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea6e6-8401-43f8-b71a-1a66bec726a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.606957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea6e6-8401-43f8-b71a-1a66bec726a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.607443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea6e6-8401-43f8-b71a-1a66bec726a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.607806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea6e6-8401-43f8-b71a-1a66bec726a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.617269 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1064/2127] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:09.621066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea6e6-8401-43f8-b71a-1a66bec726a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.622815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea6e6-8401-43f8-b71a-1a66bec726a8 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.639791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1064/2128] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:09.664491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.747057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7adbe-1514-4141-aa16-bd282c23343c service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:09.752608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:09.753549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.754487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.754806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] PATH_INFO: `/v3/users/f3c6d0837618423ea049934847caae07` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.756028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c6d0837618423ea049934847caae07)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:09.758736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:09.837262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c6d0837618423ea049934847caae07'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:09.838069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c6d0837618423ea049934847caae07'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:09.849671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c6d0837618423ea049934847caae07'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:09.860923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c6d0837618423ea049934847caae07'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:09.861744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c6d0837618423ea049934847caae07'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:09.886234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1065/2129] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:09 2022] DELETE /identity/v3/users/f3c6d0837618423ea049934847caae07 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:09.890818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600cb27-2ce7-4414-ad64-980498a40387 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:09.891379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600cb27-2ce7-4414-ad64-980498a40387 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:09.891798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600cb27-2ce7-4414-ad64-980498a40387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:09.911357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:09.933142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2600cb27-2ce7-4414-ad64-980498a40387 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:09.933970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:09.935278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2600cb27-2ce7-4414-ad64-980498a40387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:09.935898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:10.070377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79740ba7-858c-4feb-861d-2296fadc12f4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:10.077729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:10.079102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:10.079450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:10.080298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] PATH_INFO: `/v3/projects/b6f66f45f84a40b9af0ee5f8a1242aff` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:10.081909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f66f45f84a40b9af0ee5f8a1242aff)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:10.085123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:10.102640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1065/2130] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:10.114414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:10.115622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600cb27-2ce7-4414-ad64-980498a40387 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:10.117705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2600cb27-2ce7-4414-ad64-980498a40387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:10.185200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f66f45f84a40b9af0ee5f8a1242aff', 'request_id': 'req-3d20466f-b600-4786-a5ae-991305d3eccf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.194854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f66f45f84a40b9af0ee5f8a1242aff', 'request_id': 'req-3d20466f-b600-4786-a5ae-991305d3eccf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.236123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f66f45f84a40b9af0ee5f8a1242aff', 'request_id': 'req-3d20466f-b600-4786-a5ae-991305d3eccf'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.248235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600cb27-2ce7-4414-ad64-980498a40387 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:10.273201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] The token cache is being invalidate because project b6f66f45f84a40b9af0ee5f8a1242aff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:10.273502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.274245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.276186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1066/2131] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:09 2022] DELETE /identity/v3/projects/b6f66f45f84a40b9af0ee5f8a1242aff => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:10.280263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:10.282844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:10.375415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:10.376396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:10.376685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:10.376955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:10.381264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:10.391441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20466f-b600-4786-a5ae-991305d3eccf admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:10.397319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:10.398437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:10.398548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:10.398772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] PATH_INFO: `/v3/users/acb78fe7c9744b65974d932218f93c79` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:10.400871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb78fe7c9744b65974d932218f93c79)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:10.403275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:10.414687 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:10.416154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:10.431725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1066/2132] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:10.468141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb78fe7c9744b65974d932218f93c79'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.469013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb78fe7c9744b65974d932218f93c79'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.484750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb78fe7c9744b65974d932218f93c79'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.492646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb78fe7c9744b65974d932218f93c79'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.493809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb78fe7c9744b65974d932218f93c79'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:10.512859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1067/2133] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:10 2022] DELETE /identity/v3/users/acb78fe7c9744b65974d932218f93c79 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:10.996315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:11.015537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9826bd-be68-4afa-bf27-54be406b96bc service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:11.031995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:11.034849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:11.093205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:11.112621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:11.113278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:11.113558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:11.113866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] PATH_INFO: `/v3/projects/07c71bf9fa0f4c59865305f727e5aa6b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:11.115144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07c71bf9fa0f4c59865305f727e5aa6b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:11.117345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:11.124982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:11.154844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519870d5-2cf3-4935-a634-46216118cc60 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:11.160338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:11.161038 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:11.161307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:11.161630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] PATH_INFO: `/v3/projects/32faf3cb3f214d658ecbb55c291eee6d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:11.174412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] RBAC: Authorizing `identity:delete_project(project_id=32faf3cb3f214d658ecbb55c291eee6d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:11.183957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:11.187499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07c71bf9fa0f4c59865305f727e5aa6b', 'request_id': 'req-0cc08ff4-4096-468d-8c52-de22d92b2b9e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.201746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07c71bf9fa0f4c59865305f727e5aa6b', 'request_id': 'req-0cc08ff4-4096-468d-8c52-de22d92b2b9e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.219860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07c71bf9fa0f4c59865305f727e5aa6b', 'request_id': 'req-0cc08ff4-4096-468d-8c52-de22d92b2b9e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.249852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] The token cache is being invalidate because project 07c71bf9fa0f4c59865305f727e5aa6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:11.250174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.250908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0cc08ff4-4096-468d-8c52-de22d92b2b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.255971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1067/2134] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:10 2022] DELETE /identity/v3/projects/07c71bf9fa0f4c59865305f727e5aa6b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:11.261835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7249-fd5d-40ac-bf2e-8821d6da39db None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:11.262125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7249-fd5d-40ac-bf2e-8821d6da39db None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:11.262405 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7249-fd5d-40ac-bf2e-8821d6da39db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:11.310403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32faf3cb3f214d658ecbb55c291eee6d', 'request_id': 'req-5e2348d1-3457-431e-bc08-5204a3bc858d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.312743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-59fa7249-fd5d-40ac-bf2e-8821d6da39db None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:11.314220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-59fa7249-fd5d-40ac-bf2e-8821d6da39db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:11.322719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32faf3cb3f214d658ecbb55c291eee6d', 'request_id': 'req-5e2348d1-3457-431e-bc08-5204a3bc858d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.366680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32faf3cb3f214d658ecbb55c291eee6d', 'request_id': 'req-5e2348d1-3457-431e-bc08-5204a3bc858d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.389864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] The token cache is being invalidate because project 32faf3cb3f214d658ecbb55c291eee6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:11.390250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.392146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5e2348d1-3457-431e-bc08-5204a3bc858d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:11.395918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1068/2135] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:11 2022] DELETE /identity/v3/projects/32faf3cb3f214d658ecbb55c291eee6d => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:11.510066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1068/2136] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:11.520747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b360-094e-4b5c-bf07-a27dfbd76967 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:11.521035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b360-094e-4b5c-bf07-a27dfbd76967 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:11.521339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b360-094e-4b5c-bf07-a27dfbd76967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:11.605529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2034b360-094e-4b5c-bf07-a27dfbd76967 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:11.606928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2034b360-094e-4b5c-bf07-a27dfbd76967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:11.637297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1069/2137] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:11.641903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7249-fd5d-40ac-bf2e-8821d6da39db None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:11.667173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7249-fd5d-40ac-bf2e-8821d6da39db None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:11.677434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:11.678225 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:11.678568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:11.678897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:11.680315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:11.683444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:11.686353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:11.733423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1069/2138] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:38:11.737996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b360-094e-4b5c-bf07-a27dfbd76967 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:11.754034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b360-094e-4b5c-bf07-a27dfbd76967 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:11.759278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0e48-847d-4811-ac69-16f9d1b96464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:11.759915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0e48-847d-4811-ac69-16f9d1b96464 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:11.760184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0e48-847d-4811-ac69-16f9d1b96464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:11.761794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658c0e48-847d-4811-ac69-16f9d1b96464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:11.762679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c0e48-847d-4811-ac69-16f9d1b96464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:11.769688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658c0e48-847d-4811-ac69-16f9d1b96464 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:11.835307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1070/2139] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:11 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:11.840420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:11.852497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7a0d7-a51e-4234-a9e0-d3d2e9df141e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:11.983811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed057-3fe2-442e-b29f-e0beae35edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:11.984513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed057-3fe2-442e-b29f-e0beae35edcd admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:11.984961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed057-3fe2-442e-b29f-e0beae35edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:11.985930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed057-3fe2-442e-b29f-e0beae35edcd admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:11.987943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eed057-3fe2-442e-b29f-e0beae35edcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:11.988221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eed057-3fe2-442e-b29f-e0beae35edcd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:12.045964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1070/2140] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:11 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:12.051527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0e48-847d-4811-ac69-16f9d1b96464 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:12.077687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658c0e48-847d-4811-ac69-16f9d1b96464 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:12.094741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00b1a3-e0b9-450c-a28f-97897bf6600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:12.095442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00b1a3-e0b9-450c-a28f-97897bf6600d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.096440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00b1a3-e0b9-450c-a28f-97897bf6600d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.096794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00b1a3-e0b9-450c-a28f-97897bf6600d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.100616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00b1a3-e0b9-450c-a28f-97897bf6600d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:12.106452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00b1a3-e0b9-450c-a28f-97897bf6600d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:12.132527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1071/2141] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:12.147108 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed057-3fe2-442e-b29f-e0beae35edcd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:12.158792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed057-3fe2-442e-b29f-e0beae35edcd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:12.165894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd46c63-0a1b-4631-8035-257dc4040593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:12.166542 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd46c63-0a1b-4631-8035-257dc4040593 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.166978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd46c63-0a1b-4631-8035-257dc4040593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.167459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd46c63-0a1b-4631-8035-257dc4040593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.168468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd46c63-0a1b-4631-8035-257dc4040593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:12.170719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd46c63-0a1b-4631-8035-257dc4040593 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:12.178274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:12.188216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1071/2142] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:12.188751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00b1a3-e0b9-450c-a28f-97897bf6600d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:12.200285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00b1a3-e0b9-450c-a28f-97897bf6600d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:12.206655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:12.207657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.208020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.208348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] PATH_INFO: `/v3/projects/d4eab43cf4b248468faddab2f735cb10/users/97775a79332f4702a29c6ca3a1fd8c27/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.242284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4eab43cf4b248468faddab2f735cb10, user_id=97775a79332f4702a29c6ca3a1fd8c27, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:12.245526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:12.274113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1072/2143] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:12 2022] PUT /identity/v3/projects/d4eab43cf4b248468faddab2f735cb10/users/97775a79332f4702a29c6ca3a1fd8c27/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:12.286053 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29226c-4f87-47d3-beec-01971ee244bb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.286479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29226c-4f87-47d3-beec-01971ee244bb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.286784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29226c-4f87-47d3-beec-01971ee244bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.323990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8a29226c-4f87-47d3-beec-01971ee244bb None None] MFA Rules not processed for user `97775a79332f4702a29c6ca3a1fd8c27`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:12.325800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8a29226c-4f87-47d3-beec-01971ee244bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:12.409590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1072/2144] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:12.422863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:12.425803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:12.499005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eabba-8f2e-4c27-a163-e68809d2b7bd None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.499563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eabba-8f2e-4c27-a163-e68809d2b7bd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.500047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1eabba-8f2e-4c27-a163-e68809d2b7bd None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.502267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1073/2145] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:38:12.513090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd699-e076-43fc-ba60-ac1ac2066269 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:12.519006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871acca0-c138-4aea-8043-8ca8a65b5748 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.519603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871acca0-c138-4aea-8043-8ca8a65b5748 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.520167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871acca0-c138-4aea-8043-8ca8a65b5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.522028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:12.522885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.523175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.523789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.535684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:12.555276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:12.555747 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-871acca0-c138-4aea-8043-8ca8a65b5748 None None] MFA Rules not processed for user `c7145e2aeb94480da001aa620d1d4ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:12.557066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:12.557180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-871acca0-c138-4aea-8043-8ca8a65b5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:12.575956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1073/2146] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:12.576809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:12.578196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:12.661712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5746-1dd8-45ba-9428-8f1bd1225f56 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:12.663175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1074/2147] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:38:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:12.666788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:12.667814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.667981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.668253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] PATH_INFO: `/v3/users/5a24cec950e04aadb6dac9d525959e9e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.669444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a24cec950e04aadb6dac9d525959e9e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:12.676639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871acca0-c138-4aea-8043-8ca8a65b5748 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:12.676991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:12.679244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-871acca0-c138-4aea-8043-8ca8a65b5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:12.700655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871acca0-c138-4aea-8043-8ca8a65b5748 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:12.715689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:12.717027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:12.718201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:12.718771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:12.731062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:12.734051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:12.748385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a24cec950e04aadb6dac9d525959e9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:12.749554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a24cec950e04aadb6dac9d525959e9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:12.750082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1075/2148] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:12.759414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a24cec950e04aadb6dac9d525959e9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:12.772327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a24cec950e04aadb6dac9d525959e9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:12.773300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a24cec950e04aadb6dac9d525959e9e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:12.796643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1074/2149] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:12 2022] DELETE /identity/v3/users/5a24cec950e04aadb6dac9d525959e9e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:12.965974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:12.967453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:12.998302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f7b09-a280-4287-818c-84adbef8094a service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.011194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.012539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.085545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.086175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.086445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.086707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.089285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.105895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc4b50-36f8-4409-ae7e-d57013fb6c26 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.110743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.111377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.111653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.111924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] PATH_INFO: `/v3/projects/25a144bb01964adfbf90cad355130767` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.113077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25a144bb01964adfbf90cad355130767)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.115458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.117694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:13.132563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:13.156605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.158173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.170956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25a144bb01964adfbf90cad355130767', 'request_id': 'req-43af066b-4569-4237-bc2a-b070c3d93301'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.173286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1076/2150] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:13.174056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.176122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.181854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25a144bb01964adfbf90cad355130767', 'request_id': 'req-43af066b-4569-4237-bc2a-b070c3d93301'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.191946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25a144bb01964adfbf90cad355130767', 'request_id': 'req-43af066b-4569-4237-bc2a-b070c3d93301'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.194547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22664e6f-d2d0-4524-ad0c-ce77e03baa50 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.212185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] The token cache is being invalidate because project 25a144bb01964adfbf90cad355130767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:13.212487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.213858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43af066b-4569-4237-bc2a-b070c3d93301 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.216067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1075/2151] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:13 2022] DELETE /identity/v3/projects/25a144bb01964adfbf90cad355130767 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:13.221019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028c742-eae5-463a-a4fe-8100371caab7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.221241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028c742-eae5-463a-a4fe-8100371caab7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.221529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028c742-eae5-463a-a4fe-8100371caab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.246599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9028c742-eae5-463a-a4fe-8100371caab7 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:13.249681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9028c742-eae5-463a-a4fe-8100371caab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.273349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.274030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.274307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.274577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] PATH_INFO: `/v3/users/4c54523567ea48bca7802aadebf86e58` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.275729 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c54523567ea48bca7802aadebf86e58)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.277651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.332314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1076/2152] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:13.332314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028c742-eae5-463a-a4fe-8100371caab7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.332562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c54523567ea48bca7802aadebf86e58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.332562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c54523567ea48bca7802aadebf86e58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.334599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9028c742-eae5-463a-a4fe-8100371caab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.338917 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c54523567ea48bca7802aadebf86e58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.347719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028c742-eae5-463a-a4fe-8100371caab7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.354815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c54523567ea48bca7802aadebf86e58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.355517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8639d1ee-328d-4cf7-a760-1c0b70820816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c54523567ea48bca7802aadebf86e58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.358914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.359657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.359998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.360410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] PATH_INFO: `/v3/users/b5bb3fee16c04165b46bea9cdfd30017` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.361746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5bb3fee16c04165b46bea9cdfd30017)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.363849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.372559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1077/2153] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:13 2022] DELETE /identity/v3/users/4c54523567ea48bca7802aadebf86e58 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:13.372559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb426-b4f6-4e2b-be33-ca23fb2af0ee None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.372559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb426-b4f6-4e2b-be33-ca23fb2af0ee None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.372559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccb426-b4f6-4e2b-be33-ca23fb2af0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.393161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2bccb426-b4f6-4e2b-be33-ca23fb2af0ee None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:13.394553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2bccb426-b4f6-4e2b-be33-ca23fb2af0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.418618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5bb3fee16c04165b46bea9cdfd30017'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.419379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5bb3fee16c04165b46bea9cdfd30017'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.427789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5bb3fee16c04165b46bea9cdfd30017'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.434646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:13.435968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5bb3fee16c04165b46bea9cdfd30017'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.436804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-09f505c3-8df8-4502-a3e8-a08bb4cc8292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5bb3fee16c04165b46bea9cdfd30017'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:13.462488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1077/2154] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:13 2022] DELETE /identity/v3/users/b5bb3fee16c04165b46bea9cdfd30017 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:13.462840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1078/2155] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:13.463907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20cdfd-77be-4f28-955a-ac61d736b8e0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.464196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20cdfd-77be-4f28-955a-ac61d736b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.464467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a20cdfd-77be-4f28-955a-ac61d736b8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.466148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decaa8a-902a-40ce-a0b6-b7dd2b0d9f2a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.466430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decaa8a-902a-40ce-a0b6-b7dd2b0d9f2a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.466703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decaa8a-902a-40ce-a0b6-b7dd2b0d9f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.486226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5decaa8a-902a-40ce-a0b6-b7dd2b0d9f2a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:13.486969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9a20cdfd-77be-4f28-955a-ac61d736b8e0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:13.487428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5decaa8a-902a-40ce-a0b6-b7dd2b0d9f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.488162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a20cdfd-77be-4f28-955a-ac61d736b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.501473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:13.555885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1079/2156] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:13.557075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decaa8a-902a-40ce-a0b6-b7dd2b0d9f2a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.561407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1078/2157] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:13.567966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decaa8a-902a-40ce-a0b6-b7dd2b0d9f2a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.569949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20cdfd-77be-4f28-955a-ac61d736b8e0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.571623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a20cdfd-77be-4f28-955a-ac61d736b8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.573706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.574416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.574756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.575096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.575814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:13.576180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.577873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.593802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1080/2158] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:13.593802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.595983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:13.632078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a20cdfd-77be-4f28-955a-ac61d736b8e0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.636613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdc97d-5408-4ec0-b367-c9d72596bb0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.637066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdc97d-5408-4ec0-b367-c9d72596bb0e service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.637345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdc97d-5408-4ec0-b367-c9d72596bb0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.637634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bdc97d-5408-4ec0-b367-c9d72596bb0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.648583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdc97d-5408-4ec0-b367-c9d72596bb0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.650099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bdc97d-5408-4ec0-b367-c9d72596bb0e service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.661921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1079/2159] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:13.662998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdc97d-5408-4ec0-b367-c9d72596bb0e service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.669964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc555d3-a352-4339-8839-b6f7dcc9cef4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.674269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf24fd-ae8d-4aec-9925-3fbf514b4ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.674490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bdc97d-5408-4ec0-b367-c9d72596bb0e service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.674881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf24fd-ae8d-4aec-9925-3fbf514b4ceb service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.675159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf24fd-ae8d-4aec-9925-3fbf514b4ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.675457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf24fd-ae8d-4aec-9925-3fbf514b4ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.679743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27ac58-245a-46ba-866c-e41368c0859f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.680585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27ac58-245a-46ba-866c-e41368c0859f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.681031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27ac58-245a-46ba-866c-e41368c0859f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.681486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27ac58-245a-46ba-866c-e41368c0859f admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.687923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27ac58-245a-46ba-866c-e41368c0859f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.688020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf24fd-ae8d-4aec-9925-3fbf514b4ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.688102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf24fd-ae8d-4aec-9925-3fbf514b4ceb service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.689015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27ac58-245a-46ba-866c-e41368c0859f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.718973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1081/2160] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:13.763845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1080/2161] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:13 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:13.769082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf24fd-ae8d-4aec-9925-3fbf514b4ceb service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.783172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf24fd-ae8d-4aec-9925-3fbf514b4ceb service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.893229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d15959-2e57-481d-b1cf-8200d846caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.893991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d15959-2e57-481d-b1cf-8200d846caa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.894422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d15959-2e57-481d-b1cf-8200d846caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.894859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d15959-2e57-481d-b1cf-8200d846caa9 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.895661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d15959-2e57-481d-b1cf-8200d846caa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.898967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d15959-2e57-481d-b1cf-8200d846caa9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.935041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1082/2162] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:13 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:13.939793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27ac58-245a-46ba-866c-e41368c0859f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.951336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27ac58-245a-46ba-866c-e41368c0859f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.955947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660fd76-b757-483a-ac67-9b5b5ee791db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.956558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660fd76-b757-483a-ac67-9b5b5ee791db admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.956830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660fd76-b757-483a-ac67-9b5b5ee791db admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.957096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660fd76-b757-483a-ac67-9b5b5ee791db admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:13.957735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660fd76-b757-483a-ac67-9b5b5ee791db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:13.959897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660fd76-b757-483a-ac67-9b5b5ee791db admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:13.970525 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1081/2163] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:13.974613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d15959-2e57-481d-b1cf-8200d846caa9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:13.983090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:13.988004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d15959-2e57-481d-b1cf-8200d846caa9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:13.998553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3375f-3992-4e45-8cc8-99c1e4f9b602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:13.999290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3375f-3992-4e45-8cc8-99c1e4f9b602 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:13.999486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3375f-3992-4e45-8cc8-99c1e4f9b602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:13.999758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3375f-3992-4e45-8cc8-99c1e4f9b602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.000485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3375f-3992-4e45-8cc8-99c1e4f9b602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:14.002599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3375f-3992-4e45-8cc8-99c1e4f9b602 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:14.015138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1083/2164] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:14.019444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660fd76-b757-483a-ac67-9b5b5ee791db admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:14.030129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660fd76-b757-483a-ac67-9b5b5ee791db admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:14.036338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:14.037156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.037432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.037697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] PATH_INFO: `/v3/projects/379e8c4381df423a92e7c6b05105a1c3/users/2dbc066c60a747cf99de32f5678c284f/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.075433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379e8c4381df423a92e7c6b05105a1c3, user_id=2dbc066c60a747cf99de32f5678c284f, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:14.094593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:14.134682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1082/2165] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:14 2022] PUT /identity/v3/projects/379e8c4381df423a92e7c6b05105a1c3/users/2dbc066c60a747cf99de32f5678c284f/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:14.142005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd1def-6185-4ee9-b86a-a607a3f86054 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.142874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd1def-6185-4ee9-b86a-a607a3f86054 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.143332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd1def-6185-4ee9-b86a-a607a3f86054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.159079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:14.160860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:14.177168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-00dd1def-6185-4ee9-b86a-a607a3f86054 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:14.179092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-00dd1def-6185-4ee9-b86a-a607a3f86054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:14.303999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1084/2166] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:14.305334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd1def-6185-4ee9-b86a-a607a3f86054 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:14.307455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-00dd1def-6185-4ee9-b86a-a607a3f86054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:14.311433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9211f-761b-46a0-9fde-aa4280345118 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:14.318826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:14.319867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.320215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.320842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] PATH_INFO: `/v3/projects/7c842103c4b44e0f8cc1006d75b59c80` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.322040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c842103c4b44e0f8cc1006d75b59c80)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:14.323145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd1def-6185-4ee9-b86a-a607a3f86054 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:14.325390 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:14.329096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:14.329662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:14.330691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.330977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.331300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] PATH_INFO: `/v3/projects/aa09b236649641279a5d153de39dd45f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.332681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa09b236649641279a5d153de39dd45f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:14.339839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:14.398243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c842103c4b44e0f8cc1006d75b59c80', 'request_id': 'req-2abd0103-a432-4be9-bc11-9a2f47c74883'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.406551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c842103c4b44e0f8cc1006d75b59c80', 'request_id': 'req-2abd0103-a432-4be9-bc11-9a2f47c74883'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.413730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c842103c4b44e0f8cc1006d75b59c80', 'request_id': 'req-2abd0103-a432-4be9-bc11-9a2f47c74883'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.433394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] The token cache is being invalidate because project 7c842103c4b44e0f8cc1006d75b59c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:14.434247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa09b236649641279a5d153de39dd45f', 'request_id': 'req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.434631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.435778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.441960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1083/2167] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:14 2022] DELETE /identity/v3/projects/7c842103c4b44e0f8cc1006d75b59c80 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:14.442590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa09b236649641279a5d153de39dd45f', 'request_id': 'req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.443411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:14.446433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:14.458731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa09b236649641279a5d153de39dd45f', 'request_id': 'req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.473912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] The token cache is being invalidate because project aa09b236649641279a5d153de39dd45f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:14.474279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.475620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.477284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1085/2168] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:14 2022] DELETE /identity/v3/projects/aa09b236649641279a5d153de39dd45f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:14.478169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:14.479567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:14.538032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abd0103-a432-4be9-bc11-9a2f47c74883 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:14.558875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfb275-bd05-4f7e-b344-6a1802cb7a5a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:14.564342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:14.565109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.565480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.565896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] PATH_INFO: `/v3/users/27da5f25d9f942a4819b2a2c181361b7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.568468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27da5f25d9f942a4819b2a2c181361b7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:14.571769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:14.593166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:14.603209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9801ff-09c2-439b-a7f2-14d1fee7ba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:14.604369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9801ff-09c2-439b-a7f2-14d1fee7ba5d service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.604756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9801ff-09c2-439b-a7f2-14d1fee7ba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.605032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9801ff-09c2-439b-a7f2-14d1fee7ba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.607945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6b9801ff-09c2-439b-a7f2-14d1fee7ba5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:14.625627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9801ff-09c2-439b-a7f2-14d1fee7ba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:14.627494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9801ff-09c2-439b-a7f2-14d1fee7ba5d service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:14.635622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27da5f25d9f942a4819b2a2c181361b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.636396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27da5f25d9f942a4819b2a2c181361b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.637867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1084/2169] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:14.639115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a57fb-7688-4014-9427-8a6cc947c746 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.639457 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a57fb-7688-4014-9427-8a6cc947c746 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.639731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a57fb-7688-4014-9427-8a6cc947c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.659465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27da5f25d9f942a4819b2a2c181361b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.665407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e86a57fb-7688-4014-9427-8a6cc947c746 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:14.667092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e86a57fb-7688-4014-9427-8a6cc947c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:14.682449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27da5f25d9f942a4819b2a2c181361b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.683168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27da5f25d9f942a4819b2a2c181361b7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:14.683616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1085/2170] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:14.691032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064980-938e-4ebc-8a90-288c462724b8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.691323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064980-938e-4ebc-8a90-288c462724b8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.691606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc064980-938e-4ebc-8a90-288c462724b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.698781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1086/2171] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:14 2022] DELETE /identity/v3/users/27da5f25d9f942a4819b2a2c181361b7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:14.715198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fc064980-938e-4ebc-8a90-288c462724b8 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:14.716535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fc064980-938e-4ebc-8a90-288c462724b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:14.798967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:14.827191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1086/2172] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:14.831657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:14.842642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23f59be-233c-41a1-a3c6-32867c1b8815 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:14.848869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:14.849501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.850322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.850786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.851446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:14.851652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:14.853270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:14.873829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1087/2173] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:38:14.875167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc064980-938e-4ebc-8a90-288c462724b8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:14.888978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc064980-938e-4ebc-8a90-288c462724b8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:14.896569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:14.897577 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:14.898170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:14.898455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:14.901623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:14.901623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:14.945051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1087/2174] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:14 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:14.945935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:14.958939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8e2711-bde4-4fc8-91cc-032597e4e589 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.053683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae913c-d1b9-41e0-a06c-103f18011c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.054351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae913c-d1b9-41e0-a06c-103f18011c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.054721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae913c-d1b9-41e0-a06c-103f18011c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.054928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae913c-d1b9-41e0-a06c-103f18011c52 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.055846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae913c-d1b9-41e0-a06c-103f18011c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.058153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae913c-d1b9-41e0-a06c-103f18011c52 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.080976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.083862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:15.089136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1088/2175] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:14 2022] POST /identity/v3/users => generated 289 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:15.090511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae913c-d1b9-41e0-a06c-103f18011c52 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.103638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae913c-d1b9-41e0-a06c-103f18011c52 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.109816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a35075-40de-4b08-95f6-a126d3a4251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.110155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35075-40de-4b08-95f6-a126d3a4251f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.110476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35075-40de-4b08-95f6-a126d3a4251f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.110752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a35075-40de-4b08-95f6-a126d3a4251f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.111529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a35075-40de-4b08-95f6-a126d3a4251f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.113115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a35075-40de-4b08-95f6-a126d3a4251f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.114069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b7cc6-a750-4daa-bb68-22ad03cef768 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.126953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1089/2176] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:15.131272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.132046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.133123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a35075-40de-4b08-95f6-a126d3a4251f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.134070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.134344 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] PATH_INFO: `/v3/projects/acd2e7a72dce4d30a072cab140b4801a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.138227 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd2e7a72dce4d30a072cab140b4801a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.142000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.147789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a35075-40de-4b08-95f6-a126d3a4251f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.152715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2c16b-c2af-43fd-808a-1b84cac6f2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.153338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2c16b-c2af-43fd-808a-1b84cac6f2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.153614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2c16b-c2af-43fd-808a-1b84cac6f2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.154333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2c16b-c2af-43fd-808a-1b84cac6f2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.154567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2c16b-c2af-43fd-808a-1b84cac6f2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.156720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2c16b-c2af-43fd-808a-1b84cac6f2c3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.168391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1090/2177] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:15.173112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2c16b-c2af-43fd-808a-1b84cac6f2c3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.186207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2c16b-c2af-43fd-808a-1b84cac6f2c3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.194535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2932ec26-0327-4d6e-9ea6-ffaafca5d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.195121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ec26-0327-4d6e-9ea6-ffaafca5d15b admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.195465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ec26-0327-4d6e-9ea6-ffaafca5d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.196353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932ec26-0327-4d6e-9ea6-ffaafca5d15b admin admin] PATH_INFO: `/v3/projects/4b342871c6ad41b0b830dddd245bc51c/users/7ba722340e964316b90e8954efde21f8/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.215441 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932ec26-0327-4d6e-9ea6-ffaafca5d15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b342871c6ad41b0b830dddd245bc51c, user_id=7ba722340e964316b90e8954efde21f8, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.218347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2932ec26-0327-4d6e-9ea6-ffaafca5d15b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.228315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd2e7a72dce4d30a072cab140b4801a', 'request_id': 'req-41210ea4-5d38-44c0-90aa-d4dbd591c628'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.235196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1091/2178] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:15 2022] PUT /identity/v3/projects/4b342871c6ad41b0b830dddd245bc51c/users/7ba722340e964316b90e8954efde21f8/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:15.236415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd2e7a72dce4d30a072cab140b4801a', 'request_id': 'req-41210ea4-5d38-44c0-90aa-d4dbd591c628'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.245281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd2e7a72dce4d30a072cab140b4801a', 'request_id': 'req-41210ea4-5d38-44c0-90aa-d4dbd591c628'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.247265 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60832d1-e2c7-4845-ab43-59861b7af2eb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.247546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60832d1-e2c7-4845-ab43-59861b7af2eb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.247933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60832d1-e2c7-4845-ab43-59861b7af2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.263624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] The token cache is being invalidate because project acd2e7a72dce4d30a072cab140b4801a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:15.263989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.264984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.266219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1088/2179] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:15 2022] DELETE /identity/v3/projects/acd2e7a72dce4d30a072cab140b4801a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:15.270291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.271632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:15.281577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d60832d1-e2c7-4845-ab43-59861b7af2eb None None] MFA Rules not processed for user `7ba722340e964316b90e8954efde21f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:15.282818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d60832d1-e2c7-4845-ab43-59861b7af2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:15.296473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:15.358362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41210ea4-5d38-44c0-90aa-d4dbd591c628 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.363766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1092/2180] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:15.368313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60832d1-e2c7-4845-ab43-59861b7af2eb None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.370001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d60832d1-e2c7-4845-ab43-59861b7af2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:15.423971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:15.441429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.442999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.443497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.443945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] PATH_INFO: `/v3/users/f2a279c72b2041c0afef882da0840f8a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.445377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2a279c72b2041c0afef882da0840f8a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.447377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.454328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60832d1-e2c7-4845-ab43-59861b7af2eb None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.460486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4726b66-03f4-480f-be73-bf16103bb2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.461456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4726b66-03f4-480f-be73-bf16103bb2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.462007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4726b66-03f4-480f-be73-bf16103bb2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.462669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4726b66-03f4-480f-be73-bf16103bb2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.463135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4726b66-03f4-480f-be73-bf16103bb2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.466376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4726b66-03f4-480f-be73-bf16103bb2e4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.504788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1093/2181] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:15 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:38:15.509730 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4726b66-03f4-480f-be73-bf16103bb2e4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.517855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2a279c72b2041c0afef882da0840f8a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.519468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2a279c72b2041c0afef882da0840f8a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.529626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2a279c72b2041c0afef882da0840f8a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.539646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2a279c72b2041c0afef882da0840f8a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.540677 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2a279c72b2041c0afef882da0840f8a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:15.564903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1089/2182] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:15 2022] DELETE /identity/v3/users/f2a279c72b2041c0afef882da0840f8a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:15.650010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4726b66-03f4-480f-be73-bf16103bb2e4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.740446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:15.780823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8522c55-0825-4d30-bc2f-a714461c4fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.781631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522c55-0825-4d30-bc2f-a714461c4fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.781963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522c55-0825-4d30-bc2f-a714461c4fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.782855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8522c55-0825-4d30-bc2f-a714461c4fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.783671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8522c55-0825-4d30-bc2f-a714461c4fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.785825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8522c55-0825-4d30-bc2f-a714461c4fb6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.841020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1094/2183] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:15 2022] POST /identity/v3/users => generated 289 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:15.843379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.844900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:15.861271 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32412a7-1905-42ea-8396-1a106f01957d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.868405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.869126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.869408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.869787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.871041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.873178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.889795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1090/2184] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:15.893057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8522c55-0825-4d30-bc2f-a714461c4fb6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.908080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8522c55-0825-4d30-bc2f-a714461c4fb6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.919599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dd641-942a-4aed-91f0-bd8f6093b60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.920230 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd641-942a-4aed-91f0-bd8f6093b60f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.920528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd641-942a-4aed-91f0-bd8f6093b60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.920880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5dd641-942a-4aed-91f0-bd8f6093b60f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.921547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dd641-942a-4aed-91f0-bd8f6093b60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.923259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5dd641-942a-4aed-91f0-bd8f6093b60f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.932925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.935075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1095/2185] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:15.935484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:15.938895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dd641-942a-4aed-91f0-bd8f6093b60f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:15.954351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5dd641-942a-4aed-91f0-bd8f6093b60f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.957645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1be79a2-1ab6-48c3-b277-5be5ab465c13 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:15.959643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608d50a-e632-4129-b444-7e0118c8a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.960425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d50a-e632-4129-b444-7e0118c8a7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.960843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d50a-e632-4129-b444-7e0118c8a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.961216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d50a-e632-4129-b444-7e0118c8a7b9 admin admin] PATH_INFO: `/v3/projects/ce58f535110a46979d224ebbf3bcbd63/users/b2ecff2bc4af463f8944feb98fd11a43/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.966381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:15.967300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:15.967586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:15.967865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] PATH_INFO: `/v3/projects/b43aa52d33424f9cb81e7542b448a994` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:15.969146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43aa52d33424f9cb81e7542b448a994)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.971275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:15.980259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608d50a-e632-4129-b444-7e0118c8a7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce58f535110a46979d224ebbf3bcbd63, user_id=b2ecff2bc4af463f8944feb98fd11a43, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:15.991576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608d50a-e632-4129-b444-7e0118c8a7b9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.004817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1096/2186] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:15 2022] PUT /identity/v3/projects/ce58f535110a46979d224ebbf3bcbd63/users/b2ecff2bc4af463f8944feb98fd11a43/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:16.032192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd7b3-b77e-4a41-b8a0-3d4a21529ebc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.032481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd7b3-b77e-4a41-b8a0-3d4a21529ebc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.032753 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0accd7b3-b77e-4a41-b8a0-3d4a21529ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.091489 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0accd7b3-b77e-4a41-b8a0-3d4a21529ebc None None] MFA Rules not processed for user `b2ecff2bc4af463f8944feb98fd11a43`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:16.093045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0accd7b3-b77e-4a41-b8a0-3d4a21529ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:16.106073 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43aa52d33424f9cb81e7542b448a994', 'request_id': 'req-2141c582-6f4e-44ff-a278-72b77c177898'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.114030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43aa52d33424f9cb81e7542b448a994', 'request_id': 'req-2141c582-6f4e-44ff-a278-72b77c177898'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.122484 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43aa52d33424f9cb81e7542b448a994', 'request_id': 'req-2141c582-6f4e-44ff-a278-72b77c177898'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.141542 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] The token cache is being invalidate because project b43aa52d33424f9cb81e7542b448a994 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:16.141968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.142826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.146111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1091/2187] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:15 2022] DELETE /identity/v3/projects/b43aa52d33424f9cb81e7542b448a994 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:16.146978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.149065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:16.187062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1097/2188] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:16.187062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a515-9840-4859-8db2-457736a3a6e3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.187062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a515-9840-4859-8db2-457736a3a6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.187062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a515-9840-4859-8db2-457736a3a6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.211337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e533a515-9840-4859-8db2-457736a3a6e3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:16.212557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e533a515-9840-4859-8db2-457736a3a6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:16.216780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:16.247695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141c582-6f4e-44ff-a278-72b77c177898 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.253567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.254376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.254785 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.255315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] PATH_INFO: `/v3/users/97775a79332f4702a29c6ca3a1fd8c27` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.257387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97775a79332f4702a29c6ca3a1fd8c27)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.259541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.283835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1098/2189] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:16.284703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a515-9840-4859-8db2-457736a3a6e3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.286369 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e533a515-9840-4859-8db2-457736a3a6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:16.299671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a515-9840-4859-8db2-457736a3a6e3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.305604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e978b-b85c-47ff-9645-4e17e6310cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.306376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e978b-b85c-47ff-9645-4e17e6310cad admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.306639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e978b-b85c-47ff-9645-4e17e6310cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.306929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e978b-b85c-47ff-9645-4e17e6310cad admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.307649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e978b-b85c-47ff-9645-4e17e6310cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.309628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e978b-b85c-47ff-9645-4e17e6310cad admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.327943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97775a79332f4702a29c6ca3a1fd8c27'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.329041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97775a79332f4702a29c6ca3a1fd8c27'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.339596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97775a79332f4702a29c6ca3a1fd8c27'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.348153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1099/2190] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:16 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:16.349642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38328d-29de-4023-be15-d08b1c284fdd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.349963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38328d-29de-4023-be15-d08b1c284fdd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.350081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97775a79332f4702a29c6ca3a1fd8c27'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.350232 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38328d-29de-4023-be15-d08b1c284fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.351182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97775a79332f4702a29c6ca3a1fd8c27'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:16.374149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4d38328d-29de-4023-be15-d08b1c284fdd None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:16.375427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4d38328d-29de-4023-be15-d08b1c284fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:16.379409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1092/2191] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:16 2022] DELETE /identity/v3/users/97775a79332f4702a29c6ca3a1fd8c27 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:16.380896 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.382771 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:16.383925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:16.469077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1100/2192] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:16.469077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0898-cbf9-4f78-8cfb-7db2baebb567 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.469077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0898-cbf9-4f78-8cfb-7db2baebb567 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.469077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a0898-cbf9-4f78-8cfb-7db2baebb567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.476204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a027e49-4ac9-449f-9f7a-76732aec8537 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.481868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe9b3-e5b8-4865-acad-061cc5cfc87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.482850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe9b3-e5b8-4865-acad-061cc5cfc87a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.483224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe9b3-e5b8-4865-acad-061cc5cfc87a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.483599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafe9b3-e5b8-4865-acad-061cc5cfc87a admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.484354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafe9b3-e5b8-4865-acad-061cc5cfc87a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.486745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafe9b3-e5b8-4865-acad-061cc5cfc87a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.497387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f47a0898-cbf9-4f78-8cfb-7db2baebb567 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:16.499008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f47a0898-cbf9-4f78-8cfb-7db2baebb567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:16.512384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1101/2193] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:16.513246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0898-cbf9-4f78-8cfb-7db2baebb567 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.515318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1093/2194] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:16 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:16.520522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe9b3-e5b8-4865-acad-061cc5cfc87a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.524560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a0898-cbf9-4f78-8cfb-7db2baebb567 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.532630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafe9b3-e5b8-4865-acad-061cc5cfc87a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.533308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.533972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.534254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.534519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.535176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:16.535647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.537235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.539889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbde7-507f-4428-9730-e6f378365dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.540988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbde7-507f-4428-9730-e6f378365dbe admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.541274 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbde7-507f-4428-9730-e6f378365dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.541546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bbde7-507f-4428-9730-e6f378365dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.542287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bbde7-507f-4428-9730-e6f378365dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.543911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bbde7-507f-4428-9730-e6f378365dbe admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.554307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1102/2195] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:16.555452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.560869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:16.562155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1094/2196] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:16.563190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbde7-507f-4428-9730-e6f378365dbe admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.592738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bbde7-507f-4428-9730-e6f378365dbe admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.609024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf8781-0973-4b61-bbc7-de281a3ae914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.610163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8781-0973-4b61-bbc7-de281a3ae914 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.611019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8781-0973-4b61-bbc7-de281a3ae914 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.614487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf8781-0973-4b61-bbc7-de281a3ae914 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.615190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf8781-0973-4b61-bbc7-de281a3ae914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.617892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf8781-0973-4b61-bbc7-de281a3ae914 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.682591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1095/2197] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:16 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:16.683138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cf80a1-a363-42a2-b7cc-f748b5e81189 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.683579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf8781-0973-4b61-bbc7-de281a3ae914 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.714441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:16.776738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf8781-0973-4b61-bbc7-de281a3ae914 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.777252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c494bb-8795-4627-8c62-d405f1d0ae65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.778516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c494bb-8795-4627-8c62-d405f1d0ae65 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.779145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c494bb-8795-4627-8c62-d405f1d0ae65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.779428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c494bb-8795-4627-8c62-d405f1d0ae65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.781624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a7535-bd28-40cf-9264-d18d79c9bd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.782336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7535-bd28-40cf-9264-d18d79c9bd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.782616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7535-bd28-40cf-9264-d18d79c9bd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.782890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588a7535-bd28-40cf-9264-d18d79c9bd14 admin admin] PATH_INFO: `/v3/projects/33f6a440e02c46918a2a0904c624f3e2/users/9ba071cf980a4219b8491d1604008009/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.793678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c494bb-8795-4627-8c62-d405f1d0ae65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.796604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c494bb-8795-4627-8c62-d405f1d0ae65 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.800784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a7535-bd28-40cf-9264-d18d79c9bd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f6a440e02c46918a2a0904c624f3e2, user_id=9ba071cf980a4219b8491d1604008009, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.803645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588a7535-bd28-40cf-9264-d18d79c9bd14 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.813242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1103/2198] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:16.814289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c494bb-8795-4627-8c62-d405f1d0ae65 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.822417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1096/2199] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:16 2022] PUT /identity/v3/projects/33f6a440e02c46918a2a0904c624f3e2/users/9ba071cf980a4219b8491d1604008009/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:16.825141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c494bb-8795-4627-8c62-d405f1d0ae65 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.826502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a7535-bd28-40cf-9264-d18d79c9bd14 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.888008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:16.906267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba463ab4-0ee7-49b0-bafd-47ab54fb29b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.906900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba463ab4-0ee7-49b0-bafd-47ab54fb29b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.907183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba463ab4-0ee7-49b0-bafd-47ab54fb29b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.907452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba463ab4-0ee7-49b0-bafd-47ab54fb29b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.908541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba463ab4-0ee7-49b0-bafd-47ab54fb29b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.911093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba463ab4-0ee7-49b0-bafd-47ab54fb29b3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.934323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588a7535-bd28-40cf-9264-d18d79c9bd14 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.943356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f7fa-ad96-4ab5-87bb-b7185adac2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.944329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f7fa-ad96-4ab5-87bb-b7185adac2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.944853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f7fa-ad96-4ab5-87bb-b7185adac2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.945559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e87f7fa-ad96-4ab5-87bb-b7185adac2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.946290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1104/2200] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:16 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:16.947093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f7fa-ad96-4ab5-87bb-b7185adac2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.948040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba463ab4-0ee7-49b0-bafd-47ab54fb29b3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.949427 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e87f7fa-ad96-4ab5-87bb-b7185adac2e9 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:16.964867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba463ab4-0ee7-49b0-bafd-47ab54fb29b3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:16.969828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1097/2201] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:16.974990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f7fa-ad96-4ab5-87bb-b7185adac2e9 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:16.978897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092bcd5-9cab-4d47-b859-4a5b9700932d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:16.979584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092bcd5-9cab-4d47-b859-4a5b9700932d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:16.979861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092bcd5-9cab-4d47-b859-4a5b9700932d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:16.980129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1092bcd5-9cab-4d47-b859-4a5b9700932d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:16.980780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092bcd5-9cab-4d47-b859-4a5b9700932d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:16.985454 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1092bcd5-9cab-4d47-b859-4a5b9700932d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:17.005774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e87f7fa-ad96-4ab5-87bb-b7185adac2e9 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:17.012283 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48109b37-db5a-457b-9e32-9476ee9a1f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:17.012963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48109b37-db5a-457b-9e32-9476ee9a1f4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.013238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48109b37-db5a-457b-9e32-9476ee9a1f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.013509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48109b37-db5a-457b-9e32-9476ee9a1f4e admin admin] PATH_INFO: `/v3/projects/33f6a440e02c46918a2a0904c624f3e2/users/9ba071cf980a4219b8491d1604008009/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.015305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1105/2202] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:17.020449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092bcd5-9cab-4d47-b859-4a5b9700932d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:17.021483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48109b37-db5a-457b-9e32-9476ee9a1f4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f6a440e02c46918a2a0904c624f3e2, user_id=9ba071cf980a4219b8491d1604008009, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:17.028107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48109b37-db5a-457b-9e32-9476ee9a1f4e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:17.046324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1092bcd5-9cab-4d47-b859-4a5b9700932d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:17.054017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1098/2203] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:16 2022] PUT /identity/v3/projects/33f6a440e02c46918a2a0904c624f3e2/users/9ba071cf980a4219b8491d1604008009/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:17.065240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071095e-d47d-4902-9bfd-77d4eaa4092f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.066250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071095e-d47d-4902-9bfd-77d4eaa4092f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.066250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1071095e-d47d-4902-9bfd-77d4eaa4092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.112339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1071095e-d47d-4902-9bfd-77d4eaa4092f None None] MFA Rules not processed for user `9ba071cf980a4219b8491d1604008009`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:17.113882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1071095e-d47d-4902-9bfd-77d4eaa4092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:17.173240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b8e91-d4cb-494e-9903-36a2c4126c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:17.174026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8e91-d4cb-494e-9903-36a2c4126c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.174588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8e91-d4cb-494e-9903-36a2c4126c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.174912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8e91-d4cb-494e-9903-36a2c4126c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.175644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b8e91-d4cb-494e-9903-36a2c4126c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:17.177360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b8e91-d4cb-494e-9903-36a2c4126c0f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:17.196001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1106/2204] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:17.201987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b8e91-d4cb-494e-9903-36a2c4126c0f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:17.225286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b8e91-d4cb-494e-9903-36a2c4126c0f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:17.234967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:17.235661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.235940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.236214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] PATH_INFO: `/v3/projects/d0ef36ddc25f4ddc88b887a78849c9be/users/b54c8bd4b1b748a69f8b942c34ab9abe/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.266597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ef36ddc25f4ddc88b887a78849c9be, user_id=b54c8bd4b1b748a69f8b942c34ab9abe, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:17.272331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:17.295895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1099/2205] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:17.295895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071095e-d47d-4902-9bfd-77d4eaa4092f None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:17.306066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1071095e-d47d-4902-9bfd-77d4eaa4092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:17.308487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1107/2206] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:17 2022] PUT /identity/v3/projects/d0ef36ddc25f4ddc88b887a78849c9be/users/b54c8bd4b1b748a69f8b942c34ab9abe/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:17.312049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:17.322313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:17.344685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1071095e-d47d-4902-9bfd-77d4eaa4092f None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:17.356764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:17.469887 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a209ee-930f-42b2-a270-c8b3ce73d6e2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:17.478506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ce17a-151e-463f-a961-08eb0671c5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:17.479144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce17a-151e-463f-a961-08eb0671c5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.479424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce17a-151e-463f-a961-08eb0671c5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.479694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ce17a-151e-463f-a961-08eb0671c5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.485499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ab2ce17a-151e-463f-a961-08eb0671c5a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:17.489359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:17.490070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.490349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.490623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] PATH_INFO: `/v3/projects/d4eab43cf4b248468faddab2f735cb10` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.493094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4eab43cf4b248468faddab2f735cb10)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:17.495102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:17.579728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4eab43cf4b248468faddab2f735cb10', 'request_id': 'req-79a1742c-68af-4248-b659-aa1105f2092d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:17.589923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4eab43cf4b248468faddab2f735cb10', 'request_id': 'req-79a1742c-68af-4248-b659-aa1105f2092d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:17.591031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:17.610007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ce17a-151e-463f-a961-08eb0671c5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:17.613076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ce17a-151e-463f-a961-08eb0671c5a9 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:17.613453 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4eab43cf4b248468faddab2f735cb10', 'request_id': 'req-79a1742c-68af-4248-b659-aa1105f2092d'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:17.635964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1108/2207] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:17.641575 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9b7b6-3a86-466e-abde-4fe709864243 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.641987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9b7b6-3a86-466e-abde-4fe709864243 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.642337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9b7b6-3a86-466e-abde-4fe709864243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.645417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] The token cache is being invalidate because project d4eab43cf4b248468faddab2f735cb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:17.645709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:17.647228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-79a1742c-68af-4248-b659-aa1105f2092d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:17.654989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1100/2208] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:17 2022] DELETE /identity/v3/projects/d4eab43cf4b248468faddab2f735cb10 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:17.660477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d2bf-976e-4b5c-9e74-66f9f179e746 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.660885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d2bf-976e-4b5c-9e74-66f9f179e746 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.661059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d2bf-976e-4b5c-9e74-66f9f179e746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.681645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d9f9b7b6-3a86-466e-abde-4fe709864243 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:17.682938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d9f9b7b6-3a86-466e-abde-4fe709864243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:17.703711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2002d2bf-976e-4b5c-9e74-66f9f179e746 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:17.705392 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2002d2bf-976e-4b5c-9e74-66f9f179e746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:17.843749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1109/2209] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:17.853423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9b7b6-3a86-466e-abde-4fe709864243 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:17.855720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d9f9b7b6-3a86-466e-abde-4fe709864243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:17.914598 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1101/2210] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:17.923850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbfae-d9d9-4866-a1cc-6087b27d5799 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.924310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbfae-d9d9-4866-a1cc-6087b27d5799 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.924668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dbfae-d9d9-4866-a1cc-6087b27d5799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.964510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9b7b6-3a86-466e-abde-4fe709864243 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:17.969984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3cc46-0041-410e-8bb1-52854d4f848a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:17.970615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cc46-0041-410e-8bb1-52854d4f848a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:17.970886 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cc46-0041-410e-8bb1-52854d4f848a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:17.971247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3cc46-0041-410e-8bb1-52854d4f848a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:17.971858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a33dbfae-d9d9-4866-a1cc-6087b27d5799 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:17.976853 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a33dbfae-d9d9-4866-a1cc-6087b27d5799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:17.997635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1102/2211] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:17.998070 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3cc46-0041-410e-8bb1-52854d4f848a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:17.999664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb3cc46-0041-410e-8bb1-52854d4f848a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:18.012696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbfae-d9d9-4866-a1cc-6087b27d5799 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:18.033424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1110/2212] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:18.037364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dbfae-d9d9-4866-a1cc-6087b27d5799 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:18.052186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:18.056206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:18.056206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:18.056439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:18.057185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:18.057990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:18.062063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:18.091643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1103/2213] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:18.095564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3cc46-0041-410e-8bb1-52854d4f848a service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:18.108224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3cc46-0041-410e-8bb1-52854d4f848a service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:18.120779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfad68e-ce41-466e-b753-9fdb8d8960db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:18.121412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad68e-ce41-466e-b753-9fdb8d8960db admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:18.121693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad68e-ce41-466e-b753-9fdb8d8960db admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:18.122242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfad68e-ce41-466e-b753-9fdb8d8960db admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:18.122790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfad68e-ce41-466e-b753-9fdb8d8960db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:18.127514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfad68e-ce41-466e-b753-9fdb8d8960db admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:18.204678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1111/2214] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:18 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:18.208879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:18.227381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7e4be0-7d8e-4f49-b810-be63524b426e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:18.278205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:18.389145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57e305-f849-448b-aa13-467717061634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:18.390225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57e305-f849-448b-aa13-467717061634 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:18.390508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57e305-f849-448b-aa13-467717061634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:18.391521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57e305-f849-448b-aa13-467717061634 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:18.391521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57e305-f849-448b-aa13-467717061634 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:18.393585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db57e305-f849-448b-aa13-467717061634 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:18.437836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1104/2215] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:18 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:18.438467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfad68e-ce41-466e-b753-9fdb8d8960db admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:18.457488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfad68e-ce41-466e-b753-9fdb8d8960db admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:18.470999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e6ffa-5777-4262-82d2-5ab09e5290b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:18.472076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e6ffa-5777-4262-82d2-5ab09e5290b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:18.472450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e6ffa-5777-4262-82d2-5ab09e5290b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:18.472921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e6ffa-5777-4262-82d2-5ab09e5290b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:18.473677 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e6ffa-5777-4262-82d2-5ab09e5290b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:18.475500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e6ffa-5777-4262-82d2-5ab09e5290b6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:18.518514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1112/2216] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:18.519936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57e305-f849-448b-aa13-467717061634 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:18.553885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57e305-f849-448b-aa13-467717061634 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:18.564821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df42583-7651-444b-955e-a5cc513a6fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:18.565596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42583-7651-444b-955e-a5cc513a6fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:18.565912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42583-7651-444b-955e-a5cc513a6fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:18.566188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df42583-7651-444b-955e-a5cc513a6fc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:18.566840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df42583-7651-444b-955e-a5cc513a6fc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:18.568524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df42583-7651-444b-955e-a5cc513a6fc4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:18.584424 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1105/2217] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:18.589231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e6ffa-5777-4262-82d2-5ab09e5290b6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:18.600600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e6ffa-5777-4262-82d2-5ab09e5290b6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:18.605659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:18.606385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:18.606667 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:18.606927 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] PATH_INFO: `/v3/projects/6bc351831f2e48589c19dfe4268a852c/users/e3b966ec2e204756a427973507ad978c/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:18.623889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bc351831f2e48589c19dfe4268a852c, user_id=e3b966ec2e204756a427973507ad978c, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:18.627039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:18.644148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1113/2218] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:18 2022] PUT /identity/v3/projects/6bc351831f2e48589c19dfe4268a852c/users/e3b966ec2e204756a427973507ad978c/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:18.654979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31a88-3675-4d6e-b4d6-cadecdf94a55 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:18.655341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31a88-3675-4d6e-b4d6-cadecdf94a55 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:18.655533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db31a88-3675-4d6e-b4d6-cadecdf94a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:18.686275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9db31a88-3675-4d6e-b4d6-cadecdf94a55 None None] MFA Rules not processed for user `e3b966ec2e204756a427973507ad978c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:18.687558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9db31a88-3675-4d6e-b4d6-cadecdf94a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:18.845931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1106/2219] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:18.859240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:18.861961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:18.950563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:18.986062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80516adc-3362-4a3e-abad-ab073dfcff43 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:18.996349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8d3901-42bd-4e59-9102-64f2fe677a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:18.996987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d3901-42bd-4e59-9102-64f2fe677a71 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:18.997266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d3901-42bd-4e59-9102-64f2fe677a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:18.997550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8d3901-42bd-4e59-9102-64f2fe677a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:19.019501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d3901-42bd-4e59-9102-64f2fe677a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:19.020982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8d3901-42bd-4e59-9102-64f2fe677a71 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:19.042115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1114/2220] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:19.075661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db31a88-3675-4d6e-b4d6-cadecdf94a55 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:19.223805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db31a88-3675-4d6e-b4d6-cadecdf94a55 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:19.230683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:19.231432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:19.232284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:19.232810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] PATH_INFO: `/v3/users/e3b966ec2e204756a427973507ad978c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:19.236045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b966ec2e204756a427973507ad978c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:19.238987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:19.299762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:19.325517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b1c4-0242-4fbe-b623-0e535ea3a707 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:19.326027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b1c4-0242-4fbe-b623-0e535ea3a707 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:19.326221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28b1c4-0242-4fbe-b623-0e535ea3a707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:19.347938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b966ec2e204756a427973507ad978c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:19.348556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b966ec2e204756a427973507ad978c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:19.362466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b966ec2e204756a427973507ad978c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:19.374631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b966ec2e204756a427973507ad978c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:19.376581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b0ebab5d-b079-4d34-9fff-c1c2ae3b5835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b966ec2e204756a427973507ad978c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:19.382818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1d28b1c4-0242-4fbe-b623-0e535ea3a707 None None] MFA Rules not processed for user `b54c8bd4b1b748a69f8b942c34ab9abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:19.384293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1d28b1c4-0242-4fbe-b623-0e535ea3a707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:19.408213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1107/2221] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:19 2022] DELETE /identity/v3/users/e3b966ec2e204756a427973507ad978c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:19.409857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f14c6-ec5e-41a8-94ae-24f6d0d848b6 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:19.410208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f14c6-ec5e-41a8-94ae-24f6d0d848b6 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:19.410566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f14c6-ec5e-41a8-94ae-24f6d0d848b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:19.433834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3f5f14c6-ec5e-41a8-94ae-24f6d0d848b6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:19.435216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3f5f14c6-ec5e-41a8-94ae-24f6d0d848b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:19.498695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1115/2222] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:19.510936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b1c4-0242-4fbe-b623-0e535ea3a707 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:19.513252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1d28b1c4-0242-4fbe-b623-0e535ea3a707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:19.534471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1108/2223] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:19.535987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28b1c4-0242-4fbe-b623-0e535ea3a707 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:19.540876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f14c6-ec5e-41a8-94ae-24f6d0d848b6 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:19.542383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3f5f14c6-ec5e-41a8-94ae-24f6d0d848b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:19.622655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:19.623621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:19.624621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:19.625117 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:19.654007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f14c6-ec5e-41a8-94ae-24f6d0d848b6 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:19.658191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:19.658921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:19.659296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:19.659806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:19.672215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:19.674241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:19.687041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1109/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:19.687786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:19.689296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:19.704548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5512c88-de8f-46cf-89f5-6fd63d4d3341 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:19.709210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3c174-fa2c-44fc-849d-7eb96974b9c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:19.710261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3c174-fa2c-44fc-849d-7eb96974b9c6 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:19.710741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3c174-fa2c-44fc-849d-7eb96974b9c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:19.711287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3c174-fa2c-44fc-849d-7eb96974b9c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:19.713636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d6b3c174-fa2c-44fc-849d-7eb96974b9c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:19.777560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:19.784685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:19.798240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:19.820227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1116/2225] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:19.821615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3c174-fa2c-44fc-849d-7eb96974b9c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:19.823965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3c174-fa2c-44fc-849d-7eb96974b9c6 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:19.849308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1110/2226] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:20.257663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:20.259591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:20.284473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6cf65-a2a2-40cf-b90d-01b8f199dc33 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:20.292603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:20.293339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:20.293625 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:20.293972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] PATH_INFO: `/v3/projects/6bc351831f2e48589c19dfe4268a852c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:20.295420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bc351831f2e48589c19dfe4268a852c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:20.297478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:20.325991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:20.372774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bc351831f2e48589c19dfe4268a852c', 'request_id': 'req-2148723e-1170-4fde-95d2-464987e99fbb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:20.394189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bc351831f2e48589c19dfe4268a852c', 'request_id': 'req-2148723e-1170-4fde-95d2-464987e99fbb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:20.407757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bc351831f2e48589c19dfe4268a852c', 'request_id': 'req-2148723e-1170-4fde-95d2-464987e99fbb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:20.433127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] The token cache is being invalidate because project 6bc351831f2e48589c19dfe4268a852c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:20.433430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:20.434919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-2148723e-1170-4fde-95d2-464987e99fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:20.439073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1117/2227] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:20 2022] DELETE /identity/v3/projects/6bc351831f2e48589c19dfe4268a852c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:20.445264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142f82-e031-40aa-a08f-23a398c9ffcb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:20.445565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142f82-e031-40aa-a08f-23a398c9ffcb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:20.445865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c142f82-e031-40aa-a08f-23a398c9ffcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:20.480467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-9c142f82-e031-40aa-a08f-23a398c9ffcb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:20.481963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9c142f82-e031-40aa-a08f-23a398c9ffcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:20.590546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1111/2228] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:20.599406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9699-ba06-4589-b9e3-44fc6aafb596 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:20.599692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9699-ba06-4589-b9e3-44fc6aafb596 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:20.599974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d9699-ba06-4589-b9e3-44fc6aafb596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:20.642106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-592d9699-ba06-4589-b9e3-44fc6aafb596 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:20.642106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-592d9699-ba06-4589-b9e3-44fc6aafb596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:20.650690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1118/2229] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:20.650790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142f82-e031-40aa-a08f-23a398c9ffcb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:20.659845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c142f82-e031-40aa-a08f-23a398c9ffcb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:20.664644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:20.665546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:20.665546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:20.665800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:20.666715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:20.667017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:20.668815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:20.687243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d9699-ba06-4589-b9e3-44fc6aafb596 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:20.693268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1112/2230] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:38:20.698437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d9699-ba06-4589-b9e3-44fc6aafb596 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:20.706110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4a754-3179-4acd-a464-9717aeced7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:20.706989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a754-3179-4acd-a464-9717aeced7da admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:20.707435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a754-3179-4acd-a464-9717aeced7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:20.707721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c4a754-3179-4acd-a464-9717aeced7da admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:20.708500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4a754-3179-4acd-a464-9717aeced7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:20.710470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c4a754-3179-4acd-a464-9717aeced7da admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:20.752096 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1119/2231] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:20 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:20.752291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:20.765578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b38b7e0-cdd6-4c6e-823b-639a0e4be345 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:20.878637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:20.879263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:20.879541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:20.879814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:20.880452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:20.882534 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:20.915105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1113/2232] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:20 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:20.919516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4a754-3179-4acd-a464-9717aeced7da admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:20.932750 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c4a754-3179-4acd-a464-9717aeced7da admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:20.941984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f5f8-3667-4374-a99d-063b66830329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:20.942621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f5f8-3667-4374-a99d-063b66830329 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:20.943080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f5f8-3667-4374-a99d-063b66830329 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:20.943505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff7f5f8-3667-4374-a99d-063b66830329 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:20.944296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7f5f8-3667-4374-a99d-063b66830329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:20.946012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff7f5f8-3667-4374-a99d-063b66830329 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:20.946252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:20.948221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:20.972409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1120/2233] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:20.976535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f5f8-3667-4374-a99d-063b66830329 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:21.000088 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff7f5f8-3667-4374-a99d-063b66830329 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:21.007020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c17fd-af3b-4c83-a9af-3c838c2ee78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:21.007925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c17fd-af3b-4c83-a9af-3c838c2ee78c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:21.008360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c17fd-af3b-4c83-a9af-3c838c2ee78c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:21.009168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c17fd-af3b-4c83-a9af-3c838c2ee78c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:21.010550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c17fd-af3b-4c83-a9af-3c838c2ee78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:21.012518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c17fd-af3b-4c83-a9af-3c838c2ee78c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:21.026507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1121/2234] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:21.031081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c17fd-af3b-4c83-a9af-3c838c2ee78c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:21.051028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce176e-401d-4903-89d4-25d4365a3e37 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:21.056508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:21.057922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:21.058174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:21.058456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:21.060938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:21.062172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c17fd-af3b-4c83-a9af-3c838c2ee78c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:21.073665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4b6c0-af38-45dd-a574-6a9909d61daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:21.074485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b6c0-af38-45dd-a574-6a9909d61daf admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:21.074783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b6c0-af38-45dd-a574-6a9909d61daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:21.075079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4b6c0-af38-45dd-a574-6a9909d61daf admin admin] PATH_INFO: `/v3/projects/a579b6beb5ef4bc592f18a5c40808f31/users/1d8dc4bd8c454e24a8f6a7a3f81c872b/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:21.100118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4b6c0-af38-45dd-a574-6a9909d61daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a579b6beb5ef4bc592f18a5c40808f31, user_id=1d8dc4bd8c454e24a8f6a7a3f81c872b, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:21.103882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd4b6c0-af38-45dd-a574-6a9909d61daf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:21.106996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:21.139434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1122/2235] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:21 2022] PUT /identity/v3/projects/a579b6beb5ef4bc592f18a5c40808f31/users/1d8dc4bd8c454e24a8f6a7a3f81c872b/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:21.151821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340c46-8586-4242-a19b-078844926390 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:21.152134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340c46-8586-4242-a19b-078844926390 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:21.152411 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56340c46-8586-4242-a19b-078844926390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:21.203582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:21.205100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:21.227101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-56340c46-8586-4242-a19b-078844926390 None None] MFA Rules not processed for user `1d8dc4bd8c454e24a8f6a7a3f81c872b`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:21.230698 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-56340c46-8586-4242-a19b-078844926390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:21.253973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1114/2236] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:21.337189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1123/2237] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:21.387595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:21.406952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7817190-c3a0-48d3-9e49-10988e010f53 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:21.421295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa199cf-cd79-4770-9c07-97561c3ea13a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:21.421295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa199cf-cd79-4770-9c07-97561c3ea13a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:21.421574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa199cf-cd79-4770-9c07-97561c3ea13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:21.481533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f07ec-408a-446d-8e1a-40f0c3e929ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:21.481788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-aaa199cf-cd79-4770-9c07-97561c3ea13a None None] MFA Rules not processed for user `2dbc066c60a747cf99de32f5678c284f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:21.482929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aaa199cf-cd79-4770-9c07-97561c3ea13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:21.483438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f07ec-408a-446d-8e1a-40f0c3e929ee service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:21.484002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f07ec-408a-446d-8e1a-40f0c3e929ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:21.484536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f07ec-408a-446d-8e1a-40f0c3e929ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:21.497779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:21.506093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f07ec-408a-446d-8e1a-40f0c3e929ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:21.507938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f07ec-408a-446d-8e1a-40f0c3e929ee service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:21.527201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1115/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:21.571833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1124/2239] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:21.583101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358618f0-ec14-4c93-a231-4d6d4fff292a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:21.583408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358618f0-ec14-4c93-a231-4d6d4fff292a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:21.583730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358618f0-ec14-4c93-a231-4d6d4fff292a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:21.605133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-358618f0-ec14-4c93-a231-4d6d4fff292a None None] MFA Rules not processed for user `2dbc066c60a747cf99de32f5678c284f`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:21.606372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-358618f0-ec14-4c93-a231-4d6d4fff292a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:21.618587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1116/2240] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:21.627111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa199cf-cd79-4770-9c07-97561c3ea13a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:21.629834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-aaa199cf-cd79-4770-9c07-97561c3ea13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:21.722083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa199cf-cd79-4770-9c07-97561c3ea13a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:21.729168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d49c0-e929-4410-9258-1e2d080051bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:21.729925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d49c0-e929-4410-9258-1e2d080051bf service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:21.730273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d49c0-e929-4410-9258-1e2d080051bf service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:21.730717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d49c0-e929-4410-9258-1e2d080051bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:21.740476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d49c0-e929-4410-9258-1e2d080051bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:21.742523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d49c0-e929-4410-9258-1e2d080051bf service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:21.757033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1125/2241] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:22.575895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951927ef-ffe8-4ec0-a66e-ee5f6b250032 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:22.576184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951927ef-ffe8-4ec0-a66e-ee5f6b250032 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:22.576461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951927ef-ffe8-4ec0-a66e-ee5f6b250032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:22.613181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-951927ef-ffe8-4ec0-a66e-ee5f6b250032 None None] MFA Rules not processed for user `2dbc066c60a747cf99de32f5678c284f`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:22.614438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-951927ef-ffe8-4ec0-a66e-ee5f6b250032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:22.626704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1117/2242] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:22 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:22.793697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf936-7bda-4e49-87a1-36b82ee34ca3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:22.794650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf936-7bda-4e49-87a1-36b82ee34ca3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:22.794650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3bf936-7bda-4e49-87a1-36b82ee34ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:22.830367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ca3bf936-7bda-4e49-87a1-36b82ee34ca3 None None] MFA Rules not processed for user `b54c8bd4b1b748a69f8b942c34ab9abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:22.831357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ca3bf936-7bda-4e49-87a1-36b82ee34ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:22.956036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1126/2243] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:25.890667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951927ef-ffe8-4ec0-a66e-ee5f6b250032 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:25.893302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-951927ef-ffe8-4ec0-a66e-ee5f6b250032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:26.071759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951927ef-ffe8-4ec0-a66e-ee5f6b250032 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:26.086351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:26.087783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:26.089007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:26.089599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] PATH_INFO: `/v3/users/7ba722340e964316b90e8954efde21f8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:26.091451 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ba722340e964316b90e8954efde21f8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:26.095331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:26.176443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ba722340e964316b90e8954efde21f8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:26.177570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ba722340e964316b90e8954efde21f8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:26.181799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:26.195721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ba722340e964316b90e8954efde21f8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:26.214819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ba722340e964316b90e8954efde21f8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:26.217016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ba722340e964316b90e8954efde21f8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:26.288528 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1118/2244] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:25 2022] DELETE /identity/v3/users/7ba722340e964316b90e8954efde21f8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:26.290936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8af58-a591-4999-b167-1d4cc6ae0bdd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:26.291752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8af58-a591-4999-b167-1d4cc6ae0bdd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:26.292187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8af58-a591-4999-b167-1d4cc6ae0bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:26.330860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-88d8af58-a591-4999-b167-1d4cc6ae0bdd None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:26.334689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-88d8af58-a591-4999-b167-1d4cc6ae0bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:26.407453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:26.456969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1127/2245] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:26.470320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:26.473336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:26.713684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e00025-0bdf-4c1a-bbc3-88950b826733 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:26.739697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193d2a1-bd14-4798-92db-ebee178ea3d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:26.744792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193d2a1-bd14-4798-92db-ebee178ea3d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:26.746270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193d2a1-bd14-4798-92db-ebee178ea3d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:26.752789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193d2a1-bd14-4798-92db-ebee178ea3d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:26.823529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193d2a1-bd14-4798-92db-ebee178ea3d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:26.827734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193d2a1-bd14-4798-92db-ebee178ea3d2 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:26.855605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1119/2246] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:27.773243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8af58-a591-4999-b167-1d4cc6ae0bdd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:27.774832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-88d8af58-a591-4999-b167-1d4cc6ae0bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:27.792163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8af58-a591-4999-b167-1d4cc6ae0bdd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:27.799532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:27.801036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:27.801555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:27.803573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] PATH_INFO: `/v3/projects/4b342871c6ad41b0b830dddd245bc51c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:27.807179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b342871c6ad41b0b830dddd245bc51c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:27.809406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:27.916333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b342871c6ad41b0b830dddd245bc51c', 'request_id': 'req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:27.932264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b342871c6ad41b0b830dddd245bc51c', 'request_id': 'req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:27.957147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b342871c6ad41b0b830dddd245bc51c', 'request_id': 'req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:27.975627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] The token cache is being invalidate because project 4b342871c6ad41b0b830dddd245bc51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:27.976005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:27.976890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:27.978822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1128/2247] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:27 2022] DELETE /identity/v3/projects/4b342871c6ad41b0b830dddd245bc51c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:27.982748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193d2a1-bd14-4798-92db-ebee178ea3d2 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:27.995140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193d2a1-bd14-4798-92db-ebee178ea3d2 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:28.141359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:28.142049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:28.142325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:28.142593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] PATH_INFO: `/v3/users/b2ecff2bc4af463f8944feb98fd11a43` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:28.144497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2ecff2bc4af463f8944feb98fd11a43)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:28.150704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:28.245681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2ecff2bc4af463f8944feb98fd11a43'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:28.251321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2ecff2bc4af463f8944feb98fd11a43'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:28.264875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2ecff2bc4af463f8944feb98fd11a43'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:28.285402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2ecff2bc4af463f8944feb98fd11a43'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:28.287234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2ecff2bc4af463f8944feb98fd11a43'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:28.324058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:28.349703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1120/2248] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:27 2022] DELETE /identity/v3/users/b2ecff2bc4af463f8944feb98fd11a43 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:29.019377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:29.021916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:29.046891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a7929-fd4e-4c74-b96c-fb2ad132231b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:29.225291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:29.226183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:29.226637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:29.227080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] PATH_INFO: `/v3/projects/ce58f535110a46979d224ebbf3bcbd63` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:29.228412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce58f535110a46979d224ebbf3bcbd63)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:29.230916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:29.312980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce58f535110a46979d224ebbf3bcbd63', 'request_id': 'req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.320557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce58f535110a46979d224ebbf3bcbd63', 'request_id': 'req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.331168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce58f535110a46979d224ebbf3bcbd63', 'request_id': 'req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.340583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:29.348168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] The token cache is being invalidate because project ce58f535110a46979d224ebbf3bcbd63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:29.348627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.349507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.352631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1129/2249] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:29 2022] DELETE /identity/v3/projects/ce58f535110a46979d224ebbf3bcbd63 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:29.356660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:29.358967 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:29.378343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5588474-40dc-449c-9569-93ed0a459438 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:29.504101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:29.506249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:29.506746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:29.507363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] PATH_INFO: `/v3/users/9ba071cf980a4219b8491d1604008009` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:29.510846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba071cf980a4219b8491d1604008009)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:29.515811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:29.615465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba071cf980a4219b8491d1604008009'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.616203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba071cf980a4219b8491d1604008009'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.645068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba071cf980a4219b8491d1604008009'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.654302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba071cf980a4219b8491d1604008009'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.655001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-78c0fb8f-2505-4427-9aee-82634d2c3015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba071cf980a4219b8491d1604008009'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:29.704745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1121/2250] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:29 2022] DELETE /identity/v3/users/9ba071cf980a4219b8491d1604008009 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:30.396381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:30.398921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:30.417797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6e90ae-5584-44cd-b276-0ee76e0c1ad8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:30.486047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:30.486689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.486970 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.487247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] PATH_INFO: `/v3/projects/33f6a440e02c46918a2a0904c624f3e2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:30.488433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f6a440e02c46918a2a0904c624f3e2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:30.490374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:30.536376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f6a440e02c46918a2a0904c624f3e2', 'request_id': 'req-ca4d0793-dea1-448a-8636-411d1a8b3450'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:30.542530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f6a440e02c46918a2a0904c624f3e2', 'request_id': 'req-ca4d0793-dea1-448a-8636-411d1a8b3450'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:30.551574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f6a440e02c46918a2a0904c624f3e2', 'request_id': 'req-ca4d0793-dea1-448a-8636-411d1a8b3450'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:30.562231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] The token cache is being invalidate because project 33f6a440e02c46918a2a0904c624f3e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:30.562517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:30.563152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ca4d0793-dea1-448a-8636-411d1a8b3450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:30.564647 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1130/2251] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:30 2022] DELETE /identity/v3/projects/33f6a440e02c46918a2a0904c624f3e2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:30.569660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d809a8-37c6-4834-962f-e11bbefccc9a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.570212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d809a8-37c6-4834-962f-e11bbefccc9a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.570337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d809a8-37c6-4834-962f-e11bbefccc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:30.590875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-68d809a8-37c6-4834-962f-e11bbefccc9a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:30.592070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-68d809a8-37c6-4834-962f-e11bbefccc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:30.658187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1122/2252] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:30.666245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3426b-8ee4-4593-9f91-974bcbd6476c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.666513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3426b-8ee4-4593-9f91-974bcbd6476c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.666785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3426b-8ee4-4593-9f91-974bcbd6476c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:30.688063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8ce3426b-8ee4-4593-9f91-974bcbd6476c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:30.689324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8ce3426b-8ee4-4593-9f91-974bcbd6476c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:30.698905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1131/2253] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:30.703346 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d809a8-37c6-4834-962f-e11bbefccc9a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:30.713590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d809a8-37c6-4834-962f-e11bbefccc9a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:30.718744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:30.719344 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.719624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.719898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:30.720584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:30.720887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:30.722581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:30.725018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:30.739105 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1123/2254] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:30.740797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3426b-8ee4-4593-9f91-974bcbd6476c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:30.750650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3426b-8ee4-4593-9f91-974bcbd6476c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:30.755895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9a1a-e443-47fa-bfe8-af31b60c9805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:30.756486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a1a-e443-47fa-bfe8-af31b60c9805 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.756763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a1a-e443-47fa-bfe8-af31b60c9805 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.757029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee9a1a-e443-47fa-bfe8-af31b60c9805 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:30.757661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee9a1a-e443-47fa-bfe8-af31b60c9805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:30.759609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee9a1a-e443-47fa-bfe8-af31b60c9805 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:30.793205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1132/2255] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:30.797571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:30.809976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2450d85a-6abf-4b79-816b-d4db2e60c28a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:30.867762 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024f04a-f2bf-4723-806b-de31a299c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:30.868360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f04a-f2bf-4723-806b-de31a299c8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.868629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f04a-f2bf-4723-806b-de31a299c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.868890 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024f04a-f2bf-4723-806b-de31a299c8a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:30.869510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024f04a-f2bf-4723-806b-de31a299c8a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:30.871474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024f04a-f2bf-4723-806b-de31a299c8a5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:30.900295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1124/2256] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:30 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:38:30.906212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9a1a-e443-47fa-bfe8-af31b60c9805 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:30.917407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee9a1a-e443-47fa-bfe8-af31b60c9805 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:30.923519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16c0c-2cf7-403f-989c-f8997bd7dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:30.924260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16c0c-2cf7-403f-989c-f8997bd7dfdc admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.924544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16c0c-2cf7-403f-989c-f8997bd7dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.924814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d16c0c-2cf7-403f-989c-f8997bd7dfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:30.925508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d16c0c-2cf7-403f-989c-f8997bd7dfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:30.927118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d16c0c-2cf7-403f-989c-f8997bd7dfdc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:30.938851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1133/2257] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:30.942934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024f04a-f2bf-4723-806b-de31a299c8a5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:30.953894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024f04a-f2bf-4723-806b-de31a299c8a5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:30.959755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804cf65-06a8-4c16-94a8-3d1795aae71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:30.960239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cf65-06a8-4c16-94a8-3d1795aae71d admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.960527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cf65-06a8-4c16-94a8-3d1795aae71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.960863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804cf65-06a8-4c16-94a8-3d1795aae71d admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:30.961440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804cf65-06a8-4c16-94a8-3d1795aae71d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:30.963107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804cf65-06a8-4c16-94a8-3d1795aae71d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:30.974212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1125/2258] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:30.978835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16c0c-2cf7-403f-989c-f8997bd7dfdc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:30.991628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d16c0c-2cf7-403f-989c-f8997bd7dfdc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:30.997983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc491-8f1a-4d28-9367-8668511d7366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:30.998662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc491-8f1a-4d28-9367-8668511d7366 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:30.999453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc491-8f1a-4d28-9367-8668511d7366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:30.999453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bcc491-8f1a-4d28-9367-8668511d7366 admin admin] PATH_INFO: `/v3/projects/e025af4e131246f58125815201b44e37/users/7968aeca380f447ba959a35293856df6/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:31.020818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcc491-8f1a-4d28-9367-8668511d7366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e025af4e131246f58125815201b44e37, user_id=7968aeca380f447ba959a35293856df6, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:31.023713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bcc491-8f1a-4d28-9367-8668511d7366 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:31.040712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1134/2259] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:30 2022] PUT /identity/v3/projects/e025af4e131246f58125815201b44e37/users/7968aeca380f447ba959a35293856df6/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:31.051062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1924aa-861b-499b-9ee6-00379b56b87c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:31.051573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1924aa-861b-499b-9ee6-00379b56b87c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:31.051852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1924aa-861b-499b-9ee6-00379b56b87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:31.094483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bd1924aa-861b-499b-9ee6-00379b56b87c None None] MFA Rules not processed for user `7968aeca380f447ba959a35293856df6`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:31.095892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bd1924aa-861b-499b-9ee6-00379b56b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:31.201506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1126/2260] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:31.209130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc491-8f1a-4d28-9367-8668511d7366 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:31.369368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:31.461102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bcc491-8f1a-4d28-9367-8668511d7366 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:31.467986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9cab8-250b-4ab5-9303-b08bd9b2faa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:31.468849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9cab8-250b-4ab5-9303-b08bd9b2faa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:31.469345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9cab8-250b-4ab5-9303-b08bd9b2faa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:31.469784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9cab8-250b-4ab5-9303-b08bd9b2faa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:31.470883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9cab8-250b-4ab5-9303-b08bd9b2faa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:31.473379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9cab8-250b-4ab5-9303-b08bd9b2faa7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:31.516556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1135/2261] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:31 2022] POST /identity/v3/projects => generated 383 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:38:31.521206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1924aa-861b-499b-9ee6-00379b56b87c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:31.534783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1924aa-861b-499b-9ee6-00379b56b87c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:31.698337 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727a9a3-7254-4f68-8f28-8571bc90e58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:31.699687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727a9a3-7254-4f68-8f28-8571bc90e58f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:31.700179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727a9a3-7254-4f68-8f28-8571bc90e58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:31.700917 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727a9a3-7254-4f68-8f28-8571bc90e58f admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:31.702277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727a9a3-7254-4f68-8f28-8571bc90e58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:31.706085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3727a9a3-7254-4f68-8f28-8571bc90e58f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:31.746992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:31.779100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1127/2262] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:31 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:31.783259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9cab8-250b-4ab5-9303-b08bd9b2faa7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:31.796830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9cab8-250b-4ab5-9303-b08bd9b2faa7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:31.802510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931dfb8-e186-450c-91a2-1cef6ce68b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:31.803347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931dfb8-e186-450c-91a2-1cef6ce68b70 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:31.803783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931dfb8-e186-450c-91a2-1cef6ce68b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:31.804179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931dfb8-e186-450c-91a2-1cef6ce68b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:31.804971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931dfb8-e186-450c-91a2-1cef6ce68b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:31.807789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931dfb8-e186-450c-91a2-1cef6ce68b70 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:31.822618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1136/2263] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:31.826634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727a9a3-7254-4f68-8f28-8571bc90e58f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:31.843418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727a9a3-7254-4f68-8f28-8571bc90e58f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:31.848845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee8705-e7e4-4f1e-a9b8-3606ffe75e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:31.849652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee8705-e7e4-4f1e-a9b8-3606ffe75e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:31.849983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee8705-e7e4-4f1e-a9b8-3606ffe75e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:31.850241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee8705-e7e4-4f1e-a9b8-3606ffe75e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:31.850900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee8705-e7e4-4f1e-a9b8-3606ffe75e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:31.852500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ee8705-e7e4-4f1e-a9b8-3606ffe75e8b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:31.864302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1128/2264] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:31.869866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931dfb8-e186-450c-91a2-1cef6ce68b70 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:31.880205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931dfb8-e186-450c-91a2-1cef6ce68b70 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:31.884828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a9e06-e2ab-464c-ab63-94b271450974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:31.885484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9e06-e2ab-464c-ab63-94b271450974 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:31.885806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9e06-e2ab-464c-ab63-94b271450974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:31.886066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a9e06-e2ab-464c-ab63-94b271450974 admin admin] PATH_INFO: `/v3/projects/535946f7f516402487607ba33ed0ce67/users/85a4971d96484efebffc7bc2fcdf6c0a/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:31.901627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a9e06-e2ab-464c-ab63-94b271450974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=535946f7f516402487607ba33ed0ce67, user_id=85a4971d96484efebffc7bc2fcdf6c0a, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:31.904325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24a9e06-e2ab-464c-ab63-94b271450974 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:31.917654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1137/2265] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:31 2022] PUT /identity/v3/projects/535946f7f516402487607ba33ed0ce67/users/85a4971d96484efebffc7bc2fcdf6c0a/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:31.928312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023ed59-d5fa-4156-a7c5-e2a9315044e8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:31.928684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023ed59-d5fa-4156-a7c5-e2a9315044e8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:31.929090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023ed59-d5fa-4156-a7c5-e2a9315044e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:31.958922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e023ed59-d5fa-4156-a7c5-e2a9315044e8 None None] MFA Rules not processed for user `85a4971d96484efebffc7bc2fcdf6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:31.960230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e023ed59-d5fa-4156-a7c5-e2a9315044e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:32.042303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1129/2266] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:32.046995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a9e06-e2ab-464c-ab63-94b271450974 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:32.113254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a9e06-e2ab-464c-ab63-94b271450974 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:32.118569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102825-ab85-4fc5-9bc3-6a4db954912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:32.119177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102825-ab85-4fc5-9bc3-6a4db954912a admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:32.119450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102825-ab85-4fc5-9bc3-6a4db954912a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:32.119717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9102825-ab85-4fc5-9bc3-6a4db954912a admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:32.120388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102825-ab85-4fc5-9bc3-6a4db954912a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:32.122387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9102825-ab85-4fc5-9bc3-6a4db954912a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:32.150654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1138/2267] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:32 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:32.155187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023ed59-d5fa-4156-a7c5-e2a9315044e8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:32.166857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023ed59-d5fa-4156-a7c5-e2a9315044e8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:32.225833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1aa10-ddee-49ce-8172-9a89dcd653d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:32.226413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1aa10-ddee-49ce-8172-9a89dcd653d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:32.226691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1aa10-ddee-49ce-8172-9a89dcd653d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:32.227008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1aa10-ddee-49ce-8172-9a89dcd653d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:32.227664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1aa10-ddee-49ce-8172-9a89dcd653d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:32.229609 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1aa10-ddee-49ce-8172-9a89dcd653d4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:32.257823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1130/2268] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:32 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:32.259135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102825-ab85-4fc5-9bc3-6a4db954912a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:32.269942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9102825-ab85-4fc5-9bc3-6a4db954912a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:32.276023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fcb02-ea82-46c5-baeb-49e4d7aeb677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:32.276645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fcb02-ea82-46c5-baeb-49e4d7aeb677 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:32.276909 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fcb02-ea82-46c5-baeb-49e4d7aeb677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:32.277175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fcb02-ea82-46c5-baeb-49e4d7aeb677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:32.277858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fcb02-ea82-46c5-baeb-49e4d7aeb677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:32.279492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411fcb02-ea82-46c5-baeb-49e4d7aeb677 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:32.290839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1139/2269] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:32.296209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1aa10-ddee-49ce-8172-9a89dcd653d4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:32.307153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1aa10-ddee-49ce-8172-9a89dcd653d4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:32.312205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cee22-1e50-4fda-a89a-058f0118c4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:32.312872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cee22-1e50-4fda-a89a-058f0118c4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:32.313146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cee22-1e50-4fda-a89a-058f0118c4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:32.313413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cee22-1e50-4fda-a89a-058f0118c4ef admin admin] PATH_INFO: `/v3/projects/50688124d65e441f9d13b4796ae5ce2a/users/b3759bc295f64374bd8fab317aa6acee/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:32.330686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cee22-1e50-4fda-a89a-058f0118c4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=50688124d65e441f9d13b4796ae5ce2a, user_id=b3759bc295f64374bd8fab317aa6acee, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:32.334120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cee22-1e50-4fda-a89a-058f0118c4ef admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:32.353957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1131/2270] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:32 2022] PUT /identity/v3/projects/50688124d65e441f9d13b4796ae5ce2a/users/b3759bc295f64374bd8fab317aa6acee/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:32.358506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fcb02-ea82-46c5-baeb-49e4d7aeb677 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:32.369055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fcb02-ea82-46c5-baeb-49e4d7aeb677 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:32.418270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:32.432445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e9c9-661c-4d16-82d6-3194dd1203f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:32.433066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e9c9-661c-4d16-82d6-3194dd1203f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:32.433475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e9c9-661c-4d16-82d6-3194dd1203f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:32.433771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e9c9-661c-4d16-82d6-3194dd1203f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:32.434425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e9c9-661c-4d16-82d6-3194dd1203f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:32.436048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e9c9-661c-4d16-82d6-3194dd1203f1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:32.446324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1140/2271] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:32.450662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cee22-1e50-4fda-a89a-058f0118c4ef admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:32.461199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cee22-1e50-4fda-a89a-058f0118c4ef admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:32.465986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:32.466669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:32.466942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:32.467211 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] PATH_INFO: `/v3/projects/50688124d65e441f9d13b4796ae5ce2a/users/b3759bc295f64374bd8fab317aa6acee/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:32.469584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50688124d65e441f9d13b4796ae5ce2a, user_id=b3759bc295f64374bd8fab317aa6acee, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:32.472359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:32.483356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1132/2272] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:32 2022] PUT /identity/v3/projects/50688124d65e441f9d13b4796ae5ce2a/users/b3759bc295f64374bd8fab317aa6acee/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:32.494627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995336f6-974c-4bda-be61-8ede38f1d082 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:32.495102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995336f6-974c-4bda-be61-8ede38f1d082 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:32.495335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995336f6-974c-4bda-be61-8ede38f1d082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:32.525556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-995336f6-974c-4bda-be61-8ede38f1d082 None None] MFA Rules not processed for user `b3759bc295f64374bd8fab317aa6acee`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:32.526903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-995336f6-974c-4bda-be61-8ede38f1d082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:32.598578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1141/2273] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:32.614370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:32.617708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:32.653200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:32.685990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f074f7c-5a2c-4d9b-b50d-2537f058eb1d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:32.690108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a04412-d812-4221-8791-3e6630f62229 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:32.690719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04412-d812-4221-8791-3e6630f62229 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:32.690985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04412-d812-4221-8791-3e6630f62229 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:32.691250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a04412-d812-4221-8791-3e6630f62229 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:32.754873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a04412-d812-4221-8791-3e6630f62229 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:32.756455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a04412-d812-4221-8791-3e6630f62229 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:32.765739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1133/2274] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:33.574829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995336f6-974c-4bda-be61-8ede38f1d082 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:33.576371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-995336f6-974c-4bda-be61-8ede38f1d082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:33.645894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995336f6-974c-4bda-be61-8ede38f1d082 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:33.650820 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:33.651453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:33.651725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:33.651995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] PATH_INFO: `/v3/users/1d8dc4bd8c454e24a8f6a7a3f81c872b` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:33.653116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8dc4bd8c454e24a8f6a7a3f81c872b)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:33.655135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:33.716845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8dc4bd8c454e24a8f6a7a3f81c872b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:33.717575 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8dc4bd8c454e24a8f6a7a3f81c872b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:33.730646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8dc4bd8c454e24a8f6a7a3f81c872b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:33.747076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8dc4bd8c454e24a8f6a7a3f81c872b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:33.748039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8dc4bd8c454e24a8f6a7a3f81c872b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:33.749448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:33.770401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1142/2275] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:33 2022] DELETE /identity/v3/users/1d8dc4bd8c454e24a8f6a7a3f81c872b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:33.774186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21edbab-5739-4d1a-b4ee-4dbe5674c55d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:33.775591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21edbab-5739-4d1a-b4ee-4dbe5674c55d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:33.776102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21edbab-5739-4d1a-b4ee-4dbe5674c55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:33.799056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d21edbab-5739-4d1a-b4ee-4dbe5674c55d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:33.800302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d21edbab-5739-4d1a-b4ee-4dbe5674c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:33.864043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1134/2276] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:33.875296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:33.876661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:33.934336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00be6c39-6d09-47b7-91b3-7111d7644430 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:33.938262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:33.938827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:33.939007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:33.939269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:33.949608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:33.951934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:33.962186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1143/2277] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:34.379854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21edbab-5739-4d1a-b4ee-4dbe5674c55d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:34.381496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d21edbab-5739-4d1a-b4ee-4dbe5674c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:34.427656 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:34.429483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:34.449529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5a723-1d1e-4229-bc6d-312ec01a5159 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:34.461581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:34.462419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.462928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.463210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] PATH_INFO: `/v3/projects/a579b6beb5ef4bc592f18a5c40808f31` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.464526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a579b6beb5ef4bc592f18a5c40808f31)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:34.468451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:34.469345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21edbab-5739-4d1a-b4ee-4dbe5674c55d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:34.474334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453ca52-aa84-463c-a5a3-d9dd9f8d4321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:34.475146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453ca52-aa84-463c-a5a3-d9dd9f8d4321 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.475455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453ca52-aa84-463c-a5a3-d9dd9f8d4321 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.475727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453ca52-aa84-463c-a5a3-d9dd9f8d4321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.478131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f453ca52-aa84-463c-a5a3-d9dd9f8d4321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:34.514847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:34.523200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a579b6beb5ef4bc592f18a5c40808f31', 'request_id': 'req-70a7a5e0-1b76-4ca4-85ab-457ae984527d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:34.530090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a579b6beb5ef4bc592f18a5c40808f31', 'request_id': 'req-70a7a5e0-1b76-4ca4-85ab-457ae984527d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:34.540073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a579b6beb5ef4bc592f18a5c40808f31', 'request_id': 'req-70a7a5e0-1b76-4ca4-85ab-457ae984527d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:34.541941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453ca52-aa84-463c-a5a3-d9dd9f8d4321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:34.543522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453ca52-aa84-463c-a5a3-d9dd9f8d4321 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:34.552066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] The token cache is being invalidate because project a579b6beb5ef4bc592f18a5c40808f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:34.552559 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:34.552971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1135/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:34.556172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-70a7a5e0-1b76-4ca4-85ab-457ae984527d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:34.557856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1144/2279] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:34 2022] DELETE /identity/v3/projects/a579b6beb5ef4bc592f18a5c40808f31 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:34.562747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6266a6-a4d0-4c7f-adc2-1575b533b23c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.563035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6266a6-a4d0-4c7f-adc2-1575b533b23c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.563330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6266a6-a4d0-4c7f-adc2-1575b533b23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.587758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7f6266a6-a4d0-4c7f-adc2-1575b533b23c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:34.589035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7f6266a6-a4d0-4c7f-adc2-1575b533b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:34.660502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1136/2280] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:34.669583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ea6e-c82f-4f87-b47b-97287acb8e17 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.670303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ea6e-c82f-4f87-b47b-97287acb8e17 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.670587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4ea6e-c82f-4f87-b47b-97287acb8e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.692772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b5c4ea6e-c82f-4f87-b47b-97287acb8e17 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:34.694082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b5c4ea6e-c82f-4f87-b47b-97287acb8e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:34.705474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1145/2281] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:34.710143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6266a6-a4d0-4c7f-adc2-1575b533b23c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:34.726791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6266a6-a4d0-4c7f-adc2-1575b533b23c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:34.735515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:34.736546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.736976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.737253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.737952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:34.738256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:34.740172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:34.753678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1137/2282] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:34.759060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4ea6e-c82f-4f87-b47b-97287acb8e17 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:34.769980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4ea6e-c82f-4f87-b47b-97287acb8e17 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:34.775311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc655-596f-49bb-82a1-f313c243ecf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:34.776008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc655-596f-49bb-82a1-f313c243ecf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.776285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc655-596f-49bb-82a1-f313c243ecf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.776670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fdc655-596f-49bb-82a1-f313c243ecf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.777337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc655-596f-49bb-82a1-f313c243ecf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:34.779409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fdc655-596f-49bb-82a1-f313c243ecf9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:34.809766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1146/2283] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:34 2022] POST /identity/v3/projects => generated 397 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:34.814091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:34.827171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f8114-063d-405d-8986-098cc985c3a4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:34.884715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b542e4d-6116-439d-820c-7c01212ab458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:34.885365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542e4d-6116-439d-820c-7c01212ab458 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.885692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542e4d-6116-439d-820c-7c01212ab458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.885972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b542e4d-6116-439d-820c-7c01212ab458 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.886658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b542e4d-6116-439d-820c-7c01212ab458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:34.888793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b542e4d-6116-439d-820c-7c01212ab458 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:34.910859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1138/2284] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:34 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:34.915342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc655-596f-49bb-82a1-f313c243ecf9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:34.926392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fdc655-596f-49bb-82a1-f313c243ecf9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:34.931700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995eb02-0278-4565-bca2-b0f8a5212eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:34.932427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995eb02-0278-4565-bca2-b0f8a5212eba admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.932779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995eb02-0278-4565-bca2-b0f8a5212eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.933115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995eb02-0278-4565-bca2-b0f8a5212eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.933871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995eb02-0278-4565-bca2-b0f8a5212eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:34.935645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995eb02-0278-4565-bca2-b0f8a5212eba admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:34.949249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1147/2285] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:34.953892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b542e4d-6116-439d-820c-7c01212ab458 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:34.968578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b542e4d-6116-439d-820c-7c01212ab458 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:34.975603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898638d-a4c4-468a-b86b-0695d8148d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:34.981772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898638d-a4c4-468a-b86b-0695d8148d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:34.981772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898638d-a4c4-468a-b86b-0695d8148d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:34.981772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898638d-a4c4-468a-b86b-0695d8148d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:34.981772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898638d-a4c4-468a-b86b-0695d8148d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:34.981772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898638d-a4c4-468a-b86b-0695d8148d26 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:35.000554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1139/2286] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:35.004938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995eb02-0278-4565-bca2-b0f8a5212eba admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:35.017689 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995eb02-0278-4565-bca2-b0f8a5212eba admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:35.022955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:35.023952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:35.024241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:35.024524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] PATH_INFO: `/v3/projects/652fa889f67a434a8de266b4eb5c0ef2/users/4dd416aa2f334691b18ba63e31c02897/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:35.047562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] RBAC: Authorizing `identity:create_grant(project_id=652fa889f67a434a8de266b4eb5c0ef2, user_id=4dd416aa2f334691b18ba63e31c02897, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:35.050437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:35.067798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1148/2287] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:35 2022] PUT /identity/v3/projects/652fa889f67a434a8de266b4eb5c0ef2/users/4dd416aa2f334691b18ba63e31c02897/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:35.079614 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff15c7f-86a9-4178-aec8-dfffb848aa67 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:35.079995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff15c7f-86a9-4178-aec8-dfffb848aa67 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:35.081086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff15c7f-86a9-4178-aec8-dfffb848aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:35.113559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7ff15c7f-86a9-4178-aec8-dfffb848aa67 None None] MFA Rules not processed for user `4dd416aa2f334691b18ba63e31c02897`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:35.114956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7ff15c7f-86a9-4178-aec8-dfffb848aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:35.149936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:35.204953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1140/2288] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:35.214632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:35.216578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:35.220172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff15c7f-86a9-4178-aec8-dfffb848aa67 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:35.221587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7ff15c7f-86a9-4178-aec8-dfffb848aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:35.232545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:35.325957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff15c7f-86a9-4178-aec8-dfffb848aa67 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:35.330071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:35.330710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:35.331037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:35.331374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:35.333410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:35.345378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b5134-429d-4784-94ef-a41d9f1264db admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:35.354358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:35.382669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:35.383786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:35.384193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:35.410941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:35.412757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:35.432887 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1149/2289] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:35.475775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:35.478082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:35.490728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1141/2290] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:36.965688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:36.967229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:37.067460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3881fc-c94c-4964-82bf-eba7a8979663 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:37.072417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:37.073115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:37.073443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:37.073947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] PATH_INFO: `/v3/users/05962349b26d487facdf8036aa2f7d9e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:37.075134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05962349b26d487facdf8036aa2f7d9e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:37.077184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:37.128924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05962349b26d487facdf8036aa2f7d9e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.129978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05962349b26d487facdf8036aa2f7d9e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.139492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05962349b26d487facdf8036aa2f7d9e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.156700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05962349b26d487facdf8036aa2f7d9e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.158061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05962349b26d487facdf8036aa2f7d9e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.179394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1150/2291] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:36 2022] DELETE /identity/v3/users/05962349b26d487facdf8036aa2f7d9e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:37.368498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:37.380839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a82926-2083-490a-8fdd-41ae46bbfb17 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:37.441311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:37.441987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:37.442265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:37.442570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] PATH_INFO: `/v3/projects/9656274ffeab457792679e5edb11f93d` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:37.443716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9656274ffeab457792679e5edb11f93d)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:37.445660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:37.474435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:37.497661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9656274ffeab457792679e5edb11f93d', 'request_id': 'req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.504039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9656274ffeab457792679e5edb11f93d', 'request_id': 'req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.510979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9656274ffeab457792679e5edb11f93d', 'request_id': 'req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.524861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] The token cache is being invalidate because project 9656274ffeab457792679e5edb11f93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:37.525222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.526083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.527860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1142/2292] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:37 2022] DELETE /identity/v3/projects/9656274ffeab457792679e5edb11f93d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:37.532115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:37.533570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:37.546507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15fb48-8155-45b3-a611-123c19909af2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:37.579051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:37.609880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:37.610527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:37.610902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:37.611093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] PATH_INFO: `/v3/users/f1785a41b8cc4f93b6d77a130d508594` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:37.612296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1785a41b8cc4f93b6d77a130d508594)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:37.614316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:37.666076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1785a41b8cc4f93b6d77a130d508594'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.666837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1785a41b8cc4f93b6d77a130d508594'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.674947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1785a41b8cc4f93b6d77a130d508594'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.689129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1785a41b8cc4f93b6d77a130d508594'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.689848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c7e012b8-df17-4a79-b008-b12211526129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1785a41b8cc4f93b6d77a130d508594'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:37.707260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1151/2293] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:37 2022] DELETE /identity/v3/users/f1785a41b8cc4f93b6d77a130d508594 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:37.958440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:37.960051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:38.000504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5043f1-5ffc-41b8-afb8-f21e08acdc26 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:38.067531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:38.068413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.068791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.069443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] PATH_INFO: `/v3/projects/c0ea8be9cbc546d58d939bb2cf619423` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.070726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ea8be9cbc546d58d939bb2cf619423)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:38.073652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:38.139820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ea8be9cbc546d58d939bb2cf619423', 'request_id': 'req-7cce1d24-8388-4c09-a6df-eae66a3ede91'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:38.146143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ea8be9cbc546d58d939bb2cf619423', 'request_id': 'req-7cce1d24-8388-4c09-a6df-eae66a3ede91'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:38.153523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ea8be9cbc546d58d939bb2cf619423', 'request_id': 'req-7cce1d24-8388-4c09-a6df-eae66a3ede91'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:38.171361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] The token cache is being invalidate because project c0ea8be9cbc546d58d939bb2cf619423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:38.171657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:38.172387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7cce1d24-8388-4c09-a6df-eae66a3ede91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:38.174571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1143/2294] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:37 2022] DELETE /identity/v3/projects/c0ea8be9cbc546d58d939bb2cf619423 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:38.179283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b09a-641f-4e85-bc7e-50f672f23dca None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.179783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b09a-641f-4e85-bc7e-50f672f23dca None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.180284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308b09a-641f-4e85-bc7e-50f672f23dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.203545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8308b09a-641f-4e85-bc7e-50f672f23dca None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:38.204644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8308b09a-641f-4e85-bc7e-50f672f23dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:38.277957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1152/2295] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:38.283481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bc06-0615-46c5-a8d5-222bb26f345c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.283648 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bc06-0615-46c5-a8d5-222bb26f345c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.283926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bc06-0615-46c5-a8d5-222bb26f345c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.312014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ac58bc06-0615-46c5-a8d5-222bb26f345c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:38.314004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ac58bc06-0615-46c5-a8d5-222bb26f345c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:38.324288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1144/2296] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:38.333262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308b09a-641f-4e85-bc7e-50f672f23dca None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:38.344135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308b09a-641f-4e85-bc7e-50f672f23dca None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:38.350236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:38.350899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.351277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.351435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.352347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:38.352475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:38.354582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:38.374010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1153/2297] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:38.375423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58bc06-0615-46c5-a8d5-222bb26f345c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:38.387019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58bc06-0615-46c5-a8d5-222bb26f345c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:38.395801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d0262-5cd9-4a73-9dd4-07009cde74d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:38.397593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d0262-5cd9-4a73-9dd4-07009cde74d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.399341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d0262-5cd9-4a73-9dd4-07009cde74d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.406845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d0262-5cd9-4a73-9dd4-07009cde74d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.411596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d0262-5cd9-4a73-9dd4-07009cde74d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:38.411596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d0262-5cd9-4a73-9dd4-07009cde74d5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:38.471840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1145/2298] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:38 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:38.476784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:38.490378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d2308-203b-4282-a904-1c2a55faf72a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:38.544880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:38.565669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e0ed2-dd8f-4424-b944-9faed5ccafcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:38.566313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e0ed2-dd8f-4424-b944-9faed5ccafcf admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.566591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e0ed2-dd8f-4424-b944-9faed5ccafcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.566862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e0ed2-dd8f-4424-b944-9faed5ccafcf admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.567514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e0ed2-dd8f-4424-b944-9faed5ccafcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:38.569492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e0ed2-dd8f-4424-b944-9faed5ccafcf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:38.595940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1154/2299] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:38 2022] POST /identity/v3/users => generated 291 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:38.600047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d0262-5cd9-4a73-9dd4-07009cde74d5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:38.611830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d0262-5cd9-4a73-9dd4-07009cde74d5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:38.616664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6051ec3-9928-4a95-8706-a6fa87260639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:38.617310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051ec3-9928-4a95-8706-a6fa87260639 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.617599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051ec3-9928-4a95-8706-a6fa87260639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.617904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6051ec3-9928-4a95-8706-a6fa87260639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.618556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6051ec3-9928-4a95-8706-a6fa87260639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:38.620219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6051ec3-9928-4a95-8706-a6fa87260639 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:38.625974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:38.631238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1146/2300] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:38.635608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e0ed2-dd8f-4424-b944-9faed5ccafcf admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:38.646898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e0ed2-dd8f-4424-b944-9faed5ccafcf admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:38.651744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8026a-b352-46e0-bea2-417b172d7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:38.652364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8026a-b352-46e0-bea2-417b172d7fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.652639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8026a-b352-46e0-bea2-417b172d7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.652908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8026a-b352-46e0-bea2-417b172d7fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.653519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8026a-b352-46e0-bea2-417b172d7fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:38.655162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8026a-b352-46e0-bea2-417b172d7fa4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:38.666736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1155/2301] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:38.671353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6051ec3-9928-4a95-8706-a6fa87260639 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:38.682418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6051ec3-9928-4a95-8706-a6fa87260639 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:38.687273 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:38.687949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.688213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.688481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] PATH_INFO: `/v3/projects/6967f8ffab2d4a969c282ff40ff45c53/users/15a6c1c3f0f44c4d97bb8afd6f34c879/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.704887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6967f8ffab2d4a969c282ff40ff45c53, user_id=15a6c1c3f0f44c4d97bb8afd6f34c879, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:38.707652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:38.722352 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1147/2302] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:38 2022] PUT /identity/v3/projects/6967f8ffab2d4a969c282ff40ff45c53/users/15a6c1c3f0f44c4d97bb8afd6f34c879/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:38.732798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a059-b882-4058-b3fc-5fe49580c607 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.733081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a059-b882-4058-b3fc-5fe49580c607 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.733352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1a059-b882-4058-b3fc-5fe49580c607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.762980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c0c1a059-b882-4058-b3fc-5fe49580c607 None None] MFA Rules not processed for user `15a6c1c3f0f44c4d97bb8afd6f34c879`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:38.764114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c0c1a059-b882-4058-b3fc-5fe49580c607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:38.834192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1156/2303] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:38.846214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:38.848114 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:38.917710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a10f1d-45c4-442f-b8cc-dbfa191b8492 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:38.921850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9995eb-ee94-4c6f-a109-00a2914ce4ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:38.922485 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9995eb-ee94-4c6f-a109-00a2914ce4ef service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:38.922768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9995eb-ee94-4c6f-a109-00a2914ce4ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:38.923041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9995eb-ee94-4c6f-a109-00a2914ce4ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:38.933220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9995eb-ee94-4c6f-a109-00a2914ce4ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:38.934755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9995eb-ee94-4c6f-a109-00a2914ce4ef service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:38.944883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1148/2304] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:38.991114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a059-b882-4058-b3fc-5fe49580c607 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:39.063826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1a059-b882-4058-b3fc-5fe49580c607 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:39.069918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:39.070565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:39.070849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:39.071121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] PATH_INFO: `/v3/users/15a6c1c3f0f44c4d97bb8afd6f34c879` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:39.072279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a6c1c3f0f44c4d97bb8afd6f34c879)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:39.074233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:39.128534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a6c1c3f0f44c4d97bb8afd6f34c879'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.129253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a6c1c3f0f44c4d97bb8afd6f34c879'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.132251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:39.139755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a6c1c3f0f44c4d97bb8afd6f34c879'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.153686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a6c1c3f0f44c4d97bb8afd6f34c879'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.154398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a6c1c3f0f44c4d97bb8afd6f34c879'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.167615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1157/2305] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:38 2022] DELETE /identity/v3/users/15a6c1c3f0f44c4d97bb8afd6f34c879 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:39.172142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fbd37-716f-452d-855f-6482e9afefe5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:39.172433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fbd37-716f-452d-855f-6482e9afefe5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:39.172706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fbd37-716f-452d-855f-6482e9afefe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:39.191719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-875fbd37-716f-452d-855f-6482e9afefe5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:39.192986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-875fbd37-716f-452d-855f-6482e9afefe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:39.264334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1149/2306] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:39.274204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:39.275685 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:39.334398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8400b92e-1e46-4212-aa95-f662db1a9e8a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:39.338673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:39.339281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:39.339561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:39.339826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:39.349264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:39.350744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:39.360100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1158/2307] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:39.572569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fbd37-716f-452d-855f-6482e9afefe5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:39.574133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-875fbd37-716f-452d-855f-6482e9afefe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:39.586797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fbd37-716f-452d-855f-6482e9afefe5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:39.591651 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:39.592406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:39.592685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:39.593013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] PATH_INFO: `/v3/users/7968aeca380f447ba959a35293856df6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:39.594611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7968aeca380f447ba959a35293856df6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:39.612680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:39.654249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:39.655990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:39.682276 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9be078-0586-4af4-b2b9-6d237bddcc78 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:39.689158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:39.690000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:39.690375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:39.690860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] PATH_INFO: `/v3/projects/6967f8ffab2d4a969c282ff40ff45c53` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:39.692982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6967f8ffab2d4a969c282ff40ff45c53)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:39.709233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:39.726988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7968aeca380f447ba959a35293856df6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.727977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7968aeca380f447ba959a35293856df6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.741401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7968aeca380f447ba959a35293856df6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.750741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7968aeca380f447ba959a35293856df6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.751488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0ad62381-f1bf-40f3-a7ad-d25916339f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7968aeca380f447ba959a35293856df6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.767496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:39.774136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6967f8ffab2d4a969c282ff40ff45c53', 'request_id': 'req-537794a1-0478-4162-a27e-c2fd9762ebf9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.785857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6967f8ffab2d4a969c282ff40ff45c53', 'request_id': 'req-537794a1-0478-4162-a27e-c2fd9762ebf9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.789795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1150/2308] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:39 2022] DELETE /identity/v3/users/7968aeca380f447ba959a35293856df6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:39.795739 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2d0f-0656-4fb9-aa0b-cec0f4d0b250 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:39.796142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2d0f-0656-4fb9-aa0b-cec0f4d0b250 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:39.796486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2d0f-0656-4fb9-aa0b-cec0f4d0b250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:39.801002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6967f8ffab2d4a969c282ff40ff45c53', 'request_id': 'req-537794a1-0478-4162-a27e-c2fd9762ebf9'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.816378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] The token cache is being invalidate because project 6967f8ffab2d4a969c282ff40ff45c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:39.816972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.817934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-537794a1-0478-4162-a27e-c2fd9762ebf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:39.819794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1159/2309] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:39 2022] DELETE /identity/v3/projects/6967f8ffab2d4a969c282ff40ff45c53 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:39.824808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d735d-0388-48c8-88e9-b7e890612807 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:39.825190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d735d-0388-48c8-88e9-b7e890612807 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:39.825534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d735d-0388-48c8-88e9-b7e890612807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:39.831450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-03ce2d0f-0656-4fb9-aa0b-cec0f4d0b250 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:39.832743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-03ce2d0f-0656-4fb9-aa0b-cec0f4d0b250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:39.851018 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e61d735d-0388-48c8-88e9-b7e890612807 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:39.852278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e61d735d-0388-48c8-88e9-b7e890612807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:39.918467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:39.922508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1151/2310] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:39.937948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1160/2311] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:39.939247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2d0f-0656-4fb9-aa0b-cec0f4d0b250 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:39.939777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6473fc-8450-404b-b208-5d3897fb2bbf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:39.940029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6473fc-8450-404b-b208-5d3897fb2bbf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:39.940299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6473fc-8450-404b-b208-5d3897fb2bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:39.940792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-03ce2d0f-0656-4fb9-aa0b-cec0f4d0b250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:39.964889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-af6473fc-8450-404b-b208-5d3897fb2bbf None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:39.966133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-af6473fc-8450-404b-b208-5d3897fb2bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:39.974753 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1161/2312] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:39.981293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6473fc-8450-404b-b208-5d3897fb2bbf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:39.998093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6473fc-8450-404b-b208-5d3897fb2bbf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.004826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.005833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.006295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.006692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.007413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:40.007781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.010137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.016502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2d0f-0656-4fb9-aa0b-cec0f4d0b250 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.021514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bae24-3b06-42cc-850a-d870f11c2610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.022334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bae24-3b06-42cc-850a-d870f11c2610 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.022628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bae24-3b06-42cc-850a-d870f11c2610 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.022883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bae24-3b06-42cc-850a-d870f11c2610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.023448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1162/2313] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:40.027738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.035571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bae24-3b06-42cc-850a-d870f11c2610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.037236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bae24-3b06-42cc-850a-d870f11c2610 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.040612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba864c-0ac9-41c5-9e84-2fba3c7d6eb9 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.045604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae4157-c524-4db5-ac8b-dad5d329cda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.047000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4157-c524-4db5-ac8b-dad5d329cda2 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.047000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4157-c524-4db5-ac8b-dad5d329cda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.047196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae4157-c524-4db5-ac8b-dad5d329cda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.047640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1152/2314] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:40.049815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae4157-c524-4db5-ac8b-dad5d329cda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.052181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae4157-c524-4db5-ac8b-dad5d329cda2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.084644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1163/2315] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:40 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:38:40.088776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bae24-3b06-42cc-850a-d870f11c2610 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.098825 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bae24-3b06-42cc-850a-d870f11c2610 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.164747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419bb0-72c3-4486-862d-6e448d1d2a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.165841 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419bb0-72c3-4486-862d-6e448d1d2a79 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.166267 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419bb0-72c3-4486-862d-6e448d1d2a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.166610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419bb0-72c3-4486-862d-6e448d1d2a79 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.167552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c419bb0-72c3-4486-862d-6e448d1d2a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.169831 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c419bb0-72c3-4486-862d-6e448d1d2a79 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.203338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1153/2316] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:40 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:38:40.210188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae4157-c524-4db5-ac8b-dad5d329cda2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.230260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae4157-c524-4db5-ac8b-dad5d329cda2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.236059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe38e7-966b-42b7-9256-bb7806b0936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.236918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe38e7-966b-42b7-9256-bb7806b0936d admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.237395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe38e7-966b-42b7-9256-bb7806b0936d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.237896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe38e7-966b-42b7-9256-bb7806b0936d admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.238947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe38e7-966b-42b7-9256-bb7806b0936d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.240749 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfe38e7-966b-42b7-9256-bb7806b0936d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.254415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1164/2317] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:40.258479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419bb0-72c3-4486-862d-6e448d1d2a79 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.268854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419bb0-72c3-4486-862d-6e448d1d2a79 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.273878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.274497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.274773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.275041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.275690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.277619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.290995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1154/2318] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:40.292662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe38e7-966b-42b7-9256-bb7806b0936d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.304571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe38e7-966b-42b7-9256-bb7806b0936d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.309623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40454f53-1c28-4782-a525-5c0d88d13b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.310550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454f53-1c28-4782-a525-5c0d88d13b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.310821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454f53-1c28-4782-a525-5c0d88d13b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.311088 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40454f53-1c28-4782-a525-5c0d88d13b57 admin admin] PATH_INFO: `/v3/projects/f995866b95474a16b99806f6df5bf651/users/306aec2e5a474382822f57933ed32c5a/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.327143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454f53-1c28-4782-a525-5c0d88d13b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f995866b95474a16b99806f6df5bf651, user_id=306aec2e5a474382822f57933ed32c5a, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.329832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40454f53-1c28-4782-a525-5c0d88d13b57 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.350069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1165/2319] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:40 2022] PUT /identity/v3/projects/f995866b95474a16b99806f6df5bf651/users/306aec2e5a474382822f57933ed32c5a/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:40.352550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.354336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:40.360080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5079-4d91-48de-a6b7-639bfbb786b0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.360371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5079-4d91-48de-a6b7-639bfbb786b0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.360646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d5079-4d91-48de-a6b7-639bfbb786b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.373122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5c519-fa4b-4b94-9ad8-a5e1b0397fb4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.384354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:40.393660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5d5d5079-4d91-48de-a6b7-639bfbb786b0 None None] MFA Rules not processed for user `306aec2e5a474382822f57933ed32c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:40.394972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5d5d5079-4d91-48de-a6b7-639bfbb786b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:40.455655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.456376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.456728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.457068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] PATH_INFO: `/v3/projects/e025af4e131246f58125815201b44e37` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.458475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e025af4e131246f58125815201b44e37)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.460816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.480549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1166/2320] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:40.495534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d5079-4d91-48de-a6b7-639bfbb786b0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.499744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5d5d5079-4d91-48de-a6b7-639bfbb786b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:40.517171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e025af4e131246f58125815201b44e37', 'request_id': 'req-b94e1142-1c31-457a-8457-f95ebd476a39'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.528140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e025af4e131246f58125815201b44e37', 'request_id': 'req-b94e1142-1c31-457a-8457-f95ebd476a39'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.539378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e025af4e131246f58125815201b44e37', 'request_id': 'req-b94e1142-1c31-457a-8457-f95ebd476a39'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.557941 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] The token cache is being invalidate because project e025af4e131246f58125815201b44e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:40.558827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.559730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.561456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1155/2321] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:40 2022] DELETE /identity/v3/projects/e025af4e131246f58125815201b44e37 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:40.565412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.567568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:40.571325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d5079-4d91-48de-a6b7-639bfbb786b0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.593102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:40.629400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.630233 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.630606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.630902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.632648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:40.638092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e1142-1c31-457a-8457-f95ebd476a39 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.643582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.644474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.644753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.645012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] PATH_INFO: `/v3/users/85a4971d96484efebffc7bc2fcdf6c0a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.646619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85a4971d96484efebffc7bc2fcdf6c0a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.648633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.697347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.699114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:40.703707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:40.705508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85a4971d96484efebffc7bc2fcdf6c0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.706572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85a4971d96484efebffc7bc2fcdf6c0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.710198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1167/2322] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:40.716799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85a4971d96484efebffc7bc2fcdf6c0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.728174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85a4971d96484efebffc7bc2fcdf6c0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.729878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a69e240f-ded5-4ebc-8608-1a4f1b357930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85a4971d96484efebffc7bc2fcdf6c0a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:40.751594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1156/2323] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:40 2022] DELETE /identity/v3/users/85a4971d96484efebffc7bc2fcdf6c0a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:40.806507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:40.808063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:40.831447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2997779-a3e7-479d-8714-742555c91695 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:40.933879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:40.934577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:40.935006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:40.935654 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] PATH_INFO: `/v3/users/4dd416aa2f334691b18ba63e31c02897` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:40.937331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd416aa2f334691b18ba63e31c02897)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:40.940391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:41.022980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd416aa2f334691b18ba63e31c02897'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.024120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd416aa2f334691b18ba63e31c02897'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.033740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd416aa2f334691b18ba63e31c02897'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.061155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd416aa2f334691b18ba63e31c02897'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.062692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd416aa2f334691b18ba63e31c02897'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.070160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:41.079716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1168/2324] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:40 2022] DELETE /identity/v3/users/4dd416aa2f334691b18ba63e31c02897 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:41.084997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb55b5-67dd-483b-8c60-feeb9d2cb5ec None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:41.085406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb55b5-67dd-483b-8c60-feeb9d2cb5ec None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:41.086186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb55b5-67dd-483b-8c60-feeb9d2cb5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:41.118575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cfbb55b5-67dd-483b-8c60-feeb9d2cb5ec None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:41.127812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cfbb55b5-67dd-483b-8c60-feeb9d2cb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:41.133737 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:41.135742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:41.277024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ae007-81a5-4d77-98e0-50e294832a87 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:41.282463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:41.283968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:41.284468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:41.285449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] PATH_INFO: `/v3/projects/535946f7f516402487607ba33ed0ce67` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:41.288155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=535946f7f516402487607ba33ed0ce67)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:41.291060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:41.297361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1157/2325] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:41.306568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb55b5-67dd-483b-8c60-feeb9d2cb5ec None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:41.307992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cfbb55b5-67dd-483b-8c60-feeb9d2cb5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:41.346061 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '535946f7f516402487607ba33ed0ce67', 'request_id': 'req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.353549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '535946f7f516402487607ba33ed0ce67', 'request_id': 'req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.364536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '535946f7f516402487607ba33ed0ce67', 'request_id': 'req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.380186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] The token cache is being invalidate because project 535946f7f516402487607ba33ed0ce67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:41.381006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.381930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.384178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1169/2326] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:41 2022] DELETE /identity/v3/projects/535946f7f516402487607ba33ed0ce67 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:41.388586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:41.390471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:41.395415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb55b5-67dd-483b-8c60-feeb9d2cb5ec None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:41.452522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:41.453287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:41.453628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:41.454025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:41.456178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:41.472162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1de2-3bdf-4a8a-bfda-3f22666792b3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:41.477825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:41.478539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:41.478875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:41.479212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] PATH_INFO: `/v3/users/b3759bc295f64374bd8fab317aa6acee` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:41.481934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3759bc295f64374bd8fab317aa6acee)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:41.484113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:41.492634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:41.520425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:41.545474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3759bc295f64374bd8fab317aa6acee'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.547155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3759bc295f64374bd8fab317aa6acee'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.550763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:41.552387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:41.559439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3759bc295f64374bd8fab317aa6acee'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.566966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1158/2327] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:41.579241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3759bc295f64374bd8fab317aa6acee'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.580086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3759bc295f64374bd8fab317aa6acee'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:41.594105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1170/2328] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:41 2022] DELETE /identity/v3/users/b3759bc295f64374bd8fab317aa6acee => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:41.990138 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:41.992085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.017781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61803951-8653-4e2e-9082-809bfed80ce8 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.021934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.022795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.124743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.125427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341d73a-ec9a-466d-9a1b-a6bdda5d3075 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.125631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.126031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.126374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] PATH_INFO: `/v3/projects/652fa889f67a434a8de266b4eb5c0ef2` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.127572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=652fa889f67a434a8de266b4eb5c0ef2)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.129618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.130207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.130831 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.131107 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.131375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] PATH_INFO: `/v3/projects/50688124d65e441f9d13b4796ae5ce2a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.132629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50688124d65e441f9d13b4796ae5ce2a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.134584 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.179403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652fa889f67a434a8de266b4eb5c0ef2', 'request_id': 'req-c383910b-53d4-4d44-b913-ddb44bf396ed'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.182889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50688124d65e441f9d13b4796ae5ce2a', 'request_id': 'req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.184959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652fa889f67a434a8de266b4eb5c0ef2', 'request_id': 'req-c383910b-53d4-4d44-b913-ddb44bf396ed'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.189494 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50688124d65e441f9d13b4796ae5ce2a', 'request_id': 'req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.190990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652fa889f67a434a8de266b4eb5c0ef2', 'request_id': 'req-c383910b-53d4-4d44-b913-ddb44bf396ed'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.198162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50688124d65e441f9d13b4796ae5ce2a', 'request_id': 'req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.207025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] The token cache is being invalidate because project 652fa889f67a434a8de266b4eb5c0ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:42.207339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.207993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c383910b-53d4-4d44-b913-ddb44bf396ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.210516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] The token cache is being invalidate because project 50688124d65e441f9d13b4796ae5ce2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:42.210904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.211561 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-b4b5fd02-1b83-4459-9b99-ce4e31e03d88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:42.211799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1159/2329] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:41 2022] DELETE /identity/v3/projects/652fa889f67a434a8de266b4eb5c0ef2 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:42.215615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1171/2330] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:42 2022] DELETE /identity/v3/projects/50688124d65e441f9d13b4796ae5ce2a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:42.215745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48322f5f-5bb0-434c-a94d-6e9e6a964752 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.216019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48322f5f-5bb0-434c-a94d-6e9e6a964752 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.216309 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48322f5f-5bb0-434c-a94d-6e9e6a964752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.220482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4067971-381f-4974-bb2a-0ba442d62e93 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.220613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4067971-381f-4974-bb2a-0ba442d62e93 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.220850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4067971-381f-4974-bb2a-0ba442d62e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.237100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-48322f5f-5bb0-434c-a94d-6e9e6a964752 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:42.238366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-48322f5f-5bb0-434c-a94d-6e9e6a964752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.240659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a4067971-381f-4974-bb2a-0ba442d62e93 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:42.241874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a4067971-381f-4974-bb2a-0ba442d62e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.276171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:42.301373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:42.312217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1160/2331] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:42.321055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e6c7-d8f8-4ee6-96ef-be91ff1b7499 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.321372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e6c7-d8f8-4ee6-96ef-be91ff1b7499 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.321640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56e6c7-d8f8-4ee6-96ef-be91ff1b7499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.332850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1172/2332] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:42.340981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb565-69fb-43a6-835b-e2440750b4c6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.341334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb565-69fb-43a6-835b-e2440750b4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.341542 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08eb565-69fb-43a6-835b-e2440750b4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.343131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5a56e6c7-d8f8-4ee6-96ef-be91ff1b7499 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:42.343518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5a56e6c7-d8f8-4ee6-96ef-be91ff1b7499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.359978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1161/2333] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:42.361377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e6c7-d8f8-4ee6-96ef-be91ff1b7499 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.365602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b08eb565-69fb-43a6-835b-e2440750b4c6 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:42.367507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b08eb565-69fb-43a6-835b-e2440750b4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.371782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56e6c7-d8f8-4ee6-96ef-be91ff1b7499 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.377214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.377927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.378161 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1173/2334] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:42.378324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.378645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.379353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:42.379713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.381676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.388640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eb565-69fb-43a6-835b-e2440750b4c6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.394945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1162/2335] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:42.398972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.400509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08eb565-69fb-43a6-835b-e2440750b4c6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.406651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.407474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.407824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.408164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.408896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:42.409257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.409899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8745a-6cd5-462d-9b7f-f6e37da26a90 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.411068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.414693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3141b-4fea-479f-9b1f-31ec9ee23a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.415448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3141b-4fea-479f-9b1f-31ec9ee23a57 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.415630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3141b-4fea-479f-9b1f-31ec9ee23a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.416014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3141b-4fea-479f-9b1f-31ec9ee23a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.416655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3141b-4fea-479f-9b1f-31ec9ee23a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.418579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d3141b-4fea-479f-9b1f-31ec9ee23a57 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.425957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1174/2336] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:42.430193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.444736 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce6e83-761a-4a6a-89e7-afc73310baef admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.450090 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ab42-a5ac-4283-a7fc-956613f19749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.451252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ab42-a5ac-4283-a7fc-956613f19749 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.451945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ab42-a5ac-4283-a7fc-956613f19749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.452571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7ab42-a5ac-4283-a7fc-956613f19749 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.456674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7ab42-a5ac-4283-a7fc-956613f19749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.456674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d7ab42-a5ac-4283-a7fc-956613f19749 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.461589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1163/2337] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:38:42.472619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3141b-4fea-479f-9b1f-31ec9ee23a57 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.501817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1175/2338] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:42.503655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ab42-a5ac-4283-a7fc-956613f19749 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.558094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d3141b-4fea-479f-9b1f-31ec9ee23a57 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.586299 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7ab42-a5ac-4283-a7fc-956613f19749 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.591040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4199d-2b68-4e83-b45a-b036c3cf7267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.591650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4199d-2b68-4e83-b45a-b036c3cf7267 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.591960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4199d-2b68-4e83-b45a-b036c3cf7267 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.592180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4199d-2b68-4e83-b45a-b036c3cf7267 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.592814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4199d-2b68-4e83-b45a-b036c3cf7267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.595013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4199d-2b68-4e83-b45a-b036c3cf7267 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.619630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1176/2339] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/users => generated 285 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:38:42.623926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4199d-2b68-4e83-b45a-b036c3cf7267 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.630178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9ff3-a232-4c76-8fac-b2a8f4c428bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.630845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9ff3-a232-4c76-8fac-b2a8f4c428bd admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.631422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9ff3-a232-4c76-8fac-b2a8f4c428bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.631752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da9ff3-a232-4c76-8fac-b2a8f4c428bd admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.632477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da9ff3-a232-4c76-8fac-b2a8f4c428bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.634594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09da9ff3-a232-4c76-8fac-b2a8f4c428bd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.635236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4199d-2b68-4e83-b45a-b036c3cf7267 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.640261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c64a-d3f6-4819-b28c-0431be542fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.641529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c64a-d3f6-4819-b28c-0431be542fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.641529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c64a-d3f6-4819-b28c-0431be542fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.641780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73c64a-d3f6-4819-b28c-0431be542fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.642766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c64a-d3f6-4819-b28c-0431be542fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.645125 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73c64a-d3f6-4819-b28c-0431be542fc2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.665424 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1164/2340] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:42.666020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1177/2341] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:42.666820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9ff3-a232-4c76-8fac-b2a8f4c428bd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.667019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c64a-d3f6-4819-b28c-0431be542fc2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.677393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09da9ff3-a232-4c76-8fac-b2a8f4c428bd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.677636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73c64a-d3f6-4819-b28c-0431be542fc2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.682975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed32e9d-6b92-433a-b293-06fb73311368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.683514 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6bf8d-18b8-485e-a3f4-9c265613ba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.683639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed32e9d-6b92-433a-b293-06fb73311368 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.683838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed32e9d-6b92-433a-b293-06fb73311368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.684044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed32e9d-6b92-433a-b293-06fb73311368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.684580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6bf8d-18b8-485e-a3f4-9c265613ba9a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.684778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed32e9d-6b92-433a-b293-06fb73311368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.685541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6bf8d-18b8-485e-a3f4-9c265613ba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.685541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e6bf8d-18b8-485e-a3f4-9c265613ba9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.686358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6bf8d-18b8-485e-a3f4-9c265613ba9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.686465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed32e9d-6b92-433a-b293-06fb73311368 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.689942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e6bf8d-18b8-485e-a3f4-9c265613ba9a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.700735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1165/2342] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:42.704659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6bf8d-18b8-485e-a3f4-9c265613ba9a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.705586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1178/2343] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:42.706581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed32e9d-6b92-433a-b293-06fb73311368 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.716178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e6bf8d-18b8-485e-a3f4-9c265613ba9a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.717306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed32e9d-6b92-433a-b293-06fb73311368 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.721265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b172857-8ff1-4753-8cf6-f61c9900c8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.721931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172857-8ff1-4753-8cf6-f61c9900c8fd admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.722213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172857-8ff1-4753-8cf6-f61c9900c8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.722451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e9552-6045-4eb4-b99d-96fd48aa4ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.722628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b172857-8ff1-4753-8cf6-f61c9900c8fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.723087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9552-6045-4eb4-b99d-96fd48aa4ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.723191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b172857-8ff1-4753-8cf6-f61c9900c8fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.723392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9552-6045-4eb4-b99d-96fd48aa4ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.723630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e9552-6045-4eb4-b99d-96fd48aa4ff6 admin admin] PATH_INFO: `/v3/projects/962b0971f3034577809163b87f5db983/users/871f7ccebdaa4791bb7ddb3f366360a1/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.724747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b172857-8ff1-4753-8cf6-f61c9900c8fd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.737561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1166/2344] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:42.742357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b172857-8ff1-4753-8cf6-f61c9900c8fd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.753013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e9552-6045-4eb4-b99d-96fd48aa4ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=962b0971f3034577809163b87f5db983, user_id=871f7ccebdaa4791bb7ddb3f366360a1, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.753307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b172857-8ff1-4753-8cf6-f61c9900c8fd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.755816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e9552-6045-4eb4-b99d-96fd48aa4ff6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.758108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbc868-ee07-432d-9bbc-0b7e191e1a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.758792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc868-ee07-432d-9bbc-0b7e191e1a72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.759716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc868-ee07-432d-9bbc-0b7e191e1a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.759997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbc868-ee07-432d-9bbc-0b7e191e1a72 admin admin] PATH_INFO: `/v3/projects/edd573977cb64f70b39b2ef5d1ed1cb7/users/2e1fa41a10bc4f5883e12f41c811b125/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.769783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1179/2345] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:42 2022] PUT /identity/v3/projects/962b0971f3034577809163b87f5db983/users/871f7ccebdaa4791bb7ddb3f366360a1/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:42.780950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4fad-739d-4423-815b-145249af9f28 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.781237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4fad-739d-4423-815b-145249af9f28 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.781532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca4fad-739d-4423-815b-145249af9f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.782023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbc868-ee07-432d-9bbc-0b7e191e1a72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd573977cb64f70b39b2ef5d1ed1cb7, user_id=2e1fa41a10bc4f5883e12f41c811b125, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:42.785149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbc868-ee07-432d-9bbc-0b7e191e1a72 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:42.801648 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1167/2346] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:42 2022] PUT /identity/v3/projects/edd573977cb64f70b39b2ef5d1ed1cb7/users/2e1fa41a10bc4f5883e12f41c811b125/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:42.808470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ba0e-a1b9-4098-b281-81f53a1749a1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.808714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ba0e-a1b9-4098-b281-81f53a1749a1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.808985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4ba0e-a1b9-4098-b281-81f53a1749a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:42.818952 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-80ca4fad-739d-4423-815b-145249af9f28 None None] MFA Rules not processed for user `871f7ccebdaa4791bb7ddb3f366360a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:42.820279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-80ca4fad-739d-4423-815b-145249af9f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.830117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-57f4ba0e-a1b9-4098-b281-81f53a1749a1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:42.831520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-57f4ba0e-a1b9-4098-b281-81f53a1749a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.836204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:42.851898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:42.908360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1168/2347] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:42.909175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1180/2348] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:42.918220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4ba0e-a1b9-4098-b281-81f53a1749a1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.919779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-57f4ba0e-a1b9-4098-b281-81f53a1749a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.924639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca4fad-739d-4423-815b-145249af9f28 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:42.926369 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-80ca4fad-739d-4423-815b-145249af9f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:42.987145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f4ba0e-a1b9-4098-b281-81f53a1749a1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:42.991590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:42.992266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:42.992544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:42.992863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:43.004169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:43.005747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:43.011929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca4fad-739d-4423-815b-145249af9f28 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:43.017025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1169/2349] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:43.026601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7ff5-cd02-4d36-b8c2-ab28e1038ce2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46c91e383f44555b753b6500c9cdc44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:43.027662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7ff5-cd02-4d36-b8c2-ab28e1038ce2 service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:43.028787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7ff5-cd02-4d36-b8c2-ab28e1038ce2 service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:43.029235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7ff5-cd02-4d36-b8c2-ab28e1038ce2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:43.042872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7ff5-cd02-4d36-b8c2-ab28e1038ce2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:43.044390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7ff5-cd02-4d36-b8c2-ab28e1038ce2 service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:43.055169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1181/2350] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:38:43.639343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:43.640921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:43.653787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a54b56-3af3-42fb-a024-01650002ecdb service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:43.667218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:43.667863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:43.668135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:43.668400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] PATH_INFO: `/v3/users/306aec2e5a474382822f57933ed32c5a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:43.669517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=306aec2e5a474382822f57933ed32c5a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:43.671493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:43.733467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '306aec2e5a474382822f57933ed32c5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:43.734075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '306aec2e5a474382822f57933ed32c5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:43.744712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '306aec2e5a474382822f57933ed32c5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:43.753220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '306aec2e5a474382822f57933ed32c5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:43.753948 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '306aec2e5a474382822f57933ed32c5a'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:43.793583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1170/2351] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:38:43 2022] DELETE /identity/v3/users/306aec2e5a474382822f57933ed32c5a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:43.798482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431301-0db1-460d-9ec1-b31f2edc6adc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:43.799465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431301-0db1-460d-9ec1-b31f2edc6adc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:43.799980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc431301-0db1-460d-9ec1-b31f2edc6adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:43.823153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fc431301-0db1-460d-9ec1-b31f2edc6adc None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:43.824700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fc431301-0db1-460d-9ec1-b31f2edc6adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:43.923137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1182/2352] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:43.928784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:43.931089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:44.000924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:44.087098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290c8a20-5a95-4957-a072-c809616c4e5d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:44.098289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c1caa-e642-4dc5-b1c0-ee3bd1a7eb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:44.098979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1caa-e642-4dc5-b1c0-ee3bd1a7eb53 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:44.099255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1caa-e642-4dc5-b1c0-ee3bd1a7eb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:44.099532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c1caa-e642-4dc5-b1c0-ee3bd1a7eb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:44.141696 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c1caa-e642-4dc5-b1c0-ee3bd1a7eb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:44.150518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c1caa-e642-4dc5-b1c0-ee3bd1a7eb53 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:44.203097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1171/2353] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:44.582679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431301-0db1-460d-9ec1-b31f2edc6adc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:44.584414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fc431301-0db1-460d-9ec1-b31f2edc6adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:44.605105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc431301-0db1-460d-9ec1-b31f2edc6adc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:44.613257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:44.614207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:44.615828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:44.616351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] PATH_INFO: `/v3/projects/f995866b95474a16b99806f6df5bf651` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:44.617802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f995866b95474a16b99806f6df5bf651)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:44.620166 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:44.706037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f995866b95474a16b99806f6df5bf651', 'request_id': 'req-83b08b51-e36b-4de2-b51f-48aa68ad4572'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:44.714183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f995866b95474a16b99806f6df5bf651', 'request_id': 'req-83b08b51-e36b-4de2-b51f-48aa68ad4572'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:44.723835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f995866b95474a16b99806f6df5bf651', 'request_id': 'req-83b08b51-e36b-4de2-b51f-48aa68ad4572'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:44.730472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:44.739199 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] The token cache is being invalidate because project f995866b95474a16b99806f6df5bf651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:38:44.739699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:44.740643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-83b08b51-e36b-4de2-b51f-48aa68ad4572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:38:44.742962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1183/2354] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:38:44 2022] DELETE /identity/v3/projects/f995866b95474a16b99806f6df5bf651 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:44.748959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4d39-befa-4c28-b0c1-ec4c02e60d18 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:44.749869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4d39-befa-4c28-b0c1-ec4c02e60d18 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:44.750331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba4d39-befa-4c28-b0c1-ec4c02e60d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:44.796556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e1ba4d39-befa-4c28-b0c1-ec4c02e60d18 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:44.798262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e1ba4d39-befa-4c28-b0c1-ec4c02e60d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:44.932929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1172/2355] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:38:44.942338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984fbc-0f67-4411-9fb1-ce0f74768ba2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:44.943124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984fbc-0f67-4411-9fb1-ce0f74768ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:44.943543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb984fbc-0f67-4411-9fb1-ce0f74768ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:44.988093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cb984fbc-0f67-4411-9fb1-ce0f74768ba2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:44.993844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cb984fbc-0f67-4411-9fb1-ce0f74768ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:45.009027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1184/2356] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:45.010910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba4d39-befa-4c28-b0c1-ec4c02e60d18 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:45.023404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba4d39-befa-4c28-b0c1-ec4c02e60d18 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:45.028636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:45.029656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:45.030408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:45.030883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:45.031770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:38:45.032272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:45.034135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:45.049793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1173/2357] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:38:45.052757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb984fbc-0f67-4411-9fb1-ce0f74768ba2 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:45.062639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb984fbc-0f67-4411-9fb1-ce0f74768ba2 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:45.067531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34624-2a81-4b06-a5eb-a04fb317baea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:45.068222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34624-2a81-4b06-a5eb-a04fb317baea admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:45.068563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34624-2a81-4b06-a5eb-a04fb317baea admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:45.068895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a34624-2a81-4b06-a5eb-a04fb317baea admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:45.069676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34624-2a81-4b06-a5eb-a04fb317baea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:45.071844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a34624-2a81-4b06-a5eb-a04fb317baea admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:45.143931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1185/2358] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:45 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:45.159059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:45.172952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6542e9d0-4308-4255-bfa8-9f779dcaaa2a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:45.296815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f89f-ba96-494b-aecb-32059974f143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:45.297454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f89f-ba96-494b-aecb-32059974f143 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:45.297734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f89f-ba96-494b-aecb-32059974f143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:45.298040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4f89f-ba96-494b-aecb-32059974f143 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:45.298744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4f89f-ba96-494b-aecb-32059974f143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:45.300736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4f89f-ba96-494b-aecb-32059974f143 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:45.336593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1174/2359] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:45 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:45.340996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34624-2a81-4b06-a5eb-a04fb317baea admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:45.360691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a34624-2a81-4b06-a5eb-a04fb317baea admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:45.366186 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4164df-15e4-481f-b750-781b5d36299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:45.366926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4164df-15e4-481f-b750-781b5d36299c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:45.367296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4164df-15e4-481f-b750-781b5d36299c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:45.367634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4164df-15e4-481f-b750-781b5d36299c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:45.369680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4164df-15e4-481f-b750-781b5d36299c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:45.370412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4164df-15e4-481f-b750-781b5d36299c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:45.382721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1186/2360] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:45.386834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f89f-ba96-494b-aecb-32059974f143 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:45.399144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4f89f-ba96-494b-aecb-32059974f143 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:45.410365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f17189-fbf3-48cb-b8ac-2ffecba3bd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:45.411006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17189-fbf3-48cb-b8ac-2ffecba3bd90 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:45.411366 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17189-fbf3-48cb-b8ac-2ffecba3bd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:45.411641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f17189-fbf3-48cb-b8ac-2ffecba3bd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:45.412356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f17189-fbf3-48cb-b8ac-2ffecba3bd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:45.414086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f17189-fbf3-48cb-b8ac-2ffecba3bd90 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:45.436789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1175/2361] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:45.441259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4164df-15e4-481f-b750-781b5d36299c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:45.453232 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4164df-15e4-481f-b750-781b5d36299c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:45.458500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acc76c-ee01-405a-bdae-a0ab7f757982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:45.459316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc76c-ee01-405a-bdae-a0ab7f757982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:45.459728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc76c-ee01-405a-bdae-a0ab7f757982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:45.460097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acc76c-ee01-405a-bdae-a0ab7f757982 admin admin] PATH_INFO: `/v3/projects/71d1945e484548cfbdd09abced20d3cb/users/2cffabc2d6764cbf9cab6147c7af3743/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:45.485786 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc76c-ee01-405a-bdae-a0ab7f757982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d1945e484548cfbdd09abced20d3cb, user_id=2cffabc2d6764cbf9cab6147c7af3743, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:45.488248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27acc76c-ee01-405a-bdae-a0ab7f757982 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:45.530709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1187/2362] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:45 2022] PUT /identity/v3/projects/71d1945e484548cfbdd09abced20d3cb/users/2cffabc2d6764cbf9cab6147c7af3743/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:45.533047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30e23-df31-4454-801b-71b7f695baa1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:45.533329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30e23-df31-4454-801b-71b7f695baa1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:45.533601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d30e23-df31-4454-801b-71b7f695baa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:45.573330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d5d30e23-df31-4454-801b-71b7f695baa1 None None] MFA Rules not processed for user `2cffabc2d6764cbf9cab6147c7af3743`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:45.574787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5d30e23-df31-4454-801b-71b7f695baa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:45.597234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:45.662199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1176/2363] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:48.269541 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd6d5-c83c-4b52-9b2c-4add0e1631ae None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:48.270198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd6d5-c83c-4b52-9b2c-4add0e1631ae None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:48.270198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd6d5-c83c-4b52-9b2c-4add0e1631ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:48.313892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-90ddd6d5-c83c-4b52-9b2c-4add0e1631ae None None] MFA Rules not processed for user `2e1fa41a10bc4f5883e12f41c811b125`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:48.315140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90ddd6d5-c83c-4b52-9b2c-4add0e1631ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:48.420375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1188/2364] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:48.423236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d30e23-df31-4454-801b-71b7f695baa1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:48.424792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5d30e23-df31-4454-801b-71b7f695baa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:48.496405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d30e23-df31-4454-801b-71b7f695baa1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:48.507442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498a39d-4e0d-4a55-8989-c4c7ae4429af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:48.509808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a39d-4e0d-4a55-8989-c4c7ae4429af admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:48.509808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a39d-4e0d-4a55-8989-c4c7ae4429af admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:48.509808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498a39d-4e0d-4a55-8989-c4c7ae4429af admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:48.509808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498a39d-4e0d-4a55-8989-c4c7ae4429af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:48.512000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498a39d-4e0d-4a55-8989-c4c7ae4429af admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:48.544678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1177/2365] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:38:48 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:48.546027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd6d5-c83c-4b52-9b2c-4add0e1631ae None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:48.558244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ddd6d5-c83c-4b52-9b2c-4add0e1631ae None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:48.618976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c169f39-349a-452e-8d3b-bf8ab2ba8e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:48.619611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169f39-349a-452e-8d3b-bf8ab2ba8e49 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:48.619890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169f39-349a-452e-8d3b-bf8ab2ba8e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:48.620159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c169f39-349a-452e-8d3b-bf8ab2ba8e49 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:48.620843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c169f39-349a-452e-8d3b-bf8ab2ba8e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:48.622870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c169f39-349a-452e-8d3b-bf8ab2ba8e49 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:48.649722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1189/2366] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:38:48 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:38:48.654158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498a39d-4e0d-4a55-8989-c4c7ae4429af admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:48.669706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498a39d-4e0d-4a55-8989-c4c7ae4429af admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:48.674622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce3ae3-33a8-4d5b-9f43-52f4494aeab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:48.675240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3ae3-33a8-4d5b-9f43-52f4494aeab2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:48.675521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3ae3-33a8-4d5b-9f43-52f4494aeab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:48.675794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3ae3-33a8-4d5b-9f43-52f4494aeab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:48.676843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce3ae3-33a8-4d5b-9f43-52f4494aeab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:48.686043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce3ae3-33a8-4d5b-9f43-52f4494aeab2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:48.695879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1178/2367] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:38:48.700160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c169f39-349a-452e-8d3b-bf8ab2ba8e49 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:48.715414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c169f39-349a-452e-8d3b-bf8ab2ba8e49 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:48.720295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6fcd9-b03f-4ac1-b793-0123e9328d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:48.721005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fcd9-b03f-4ac1-b793-0123e9328d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:48.721281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fcd9-b03f-4ac1-b793-0123e9328d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:48.721577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6fcd9-b03f-4ac1-b793-0123e9328d5b admin admin] PATH_INFO: `/v3/projects/cf9c1f195a7d494698042770b6ae0a02/users/8473f3f014e44afcba4b30ab6f674447/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:48.724781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:48.740066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fcd9-b03f-4ac1-b793-0123e9328d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9c1f195a7d494698042770b6ae0a02, user_id=8473f3f014e44afcba4b30ab6f674447, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:48.743007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6fcd9-b03f-4ac1-b793-0123e9328d5b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:48.759571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1190/2368] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:48 2022] PUT /identity/v3/projects/cf9c1f195a7d494698042770b6ae0a02/users/8473f3f014e44afcba4b30ab6f674447/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:38:48.763241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce3ae3-33a8-4d5b-9f43-52f4494aeab2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:48.779776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce3ae3-33a8-4d5b-9f43-52f4494aeab2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:48.854989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850522a6-d3c2-42f4-a493-c25513c88d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:48.855719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850522a6-d3c2-42f4-a493-c25513c88d74 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:48.856073 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850522a6-d3c2-42f4-a493-c25513c88d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:48.856357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850522a6-d3c2-42f4-a493-c25513c88d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:48.857005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850522a6-d3c2-42f4-a493-c25513c88d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:48.858673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850522a6-d3c2-42f4-a493-c25513c88d74 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:48.869316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1179/2369] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:38:48.874752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6fcd9-b03f-4ac1-b793-0123e9328d5b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:48.891616 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6fcd9-b03f-4ac1-b793-0123e9328d5b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:48.896512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:48.897277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:48.897506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:48.897722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] PATH_INFO: `/v3/projects/cf9c1f195a7d494698042770b6ae0a02/users/8473f3f014e44afcba4b30ab6f674447/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:48.904330 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf9c1f195a7d494698042770b6ae0a02, user_id=8473f3f014e44afcba4b30ab6f674447, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:48.907968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:48.919604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1191/2370] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:38:48 2022] PUT /identity/v3/projects/cf9c1f195a7d494698042770b6ae0a02/users/8473f3f014e44afcba4b30ab6f674447/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:38:54.187387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30092ed6-d068-48f1-96cc-a9133edac727 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:54.187969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30092ed6-d068-48f1-96cc-a9133edac727 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:54.187969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30092ed6-d068-48f1-96cc-a9133edac727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:54.219476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-30092ed6-d068-48f1-96cc-a9133edac727 None None] MFA Rules not processed for user `8473f3f014e44afcba4b30ab6f674447`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:54.220702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-30092ed6-d068-48f1-96cc-a9133edac727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:54.243168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:54.305939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1180/2371] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:54.317503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:54.319163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:54.414748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f023a5-7797-4a82-941e-58c2299c0cf1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:54.423076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:54.424291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:54.424716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:54.425103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:54.520278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:54.524770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:54.544649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1192/2372] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:38:56.021353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3271e2-cad6-440c-9d3b-d9e9ae34570d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:56.021864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3271e2-cad6-440c-9d3b-d9e9ae34570d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:56.021961 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3271e2-cad6-440c-9d3b-d9e9ae34570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:56.055131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0e3271e2-cad6-440c-9d3b-d9e9ae34570d None None] MFA Rules not processed for user `2e1fa41a10bc4f5883e12f41c811b125`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:38:56.056477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0e3271e2-cad6-440c-9d3b-d9e9ae34570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:56.066393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1181/2373] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:38:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:38:59.349148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:38:59.350774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:38:59.409516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa733-9a7e-4764-a8bd-08993d44df30 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:38:59.414095 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46c91e383f44555b753b6500c9cdc44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:38:59.414708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:38:59.414982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:38:59.415246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:38:59.436748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:38:59.475579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:38:59.477026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:38:59.486219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1193/2374] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:38:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:06.041307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=22 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:09.482284 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=17 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:18.839153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc9ad-3f0c-42f5-913f-c426e09be24d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:18.839707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc9ad-3f0c-42f5-913f-c426e09be24d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:18.839707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdc9ad-3f0c-42f5-913f-c426e09be24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:18.859417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fffdc9ad-3f0c-42f5-913f-c426e09be24d None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:18.860628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fffdc9ad-3f0c-42f5-913f-c426e09be24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:18.925206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1182/2375] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:39:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:18.973109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:18.974815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:19.073801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee6c35-8a94-46a1-a7b4-2243a8fa6647 service glance] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:19.078879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:19.079663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:19.079947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:19.080216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:19.090131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:19.091800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:19.101665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1194/2376] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:39:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:39:26.296730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccaaaf-a3ad-4270-974d-012b4aa6f02b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:26.297627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccaaaf-a3ad-4270-974d-012b4aa6f02b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:26.298087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccaaaf-a3ad-4270-974d-012b4aa6f02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:26.355682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-78ccaaaf-a3ad-4270-974d-012b4aa6f02b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:26.355682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-78ccaaaf-a3ad-4270-974d-012b4aa6f02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:26.571703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1183/2377] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:39:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:26.796954 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:26.798849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:26.838440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a84d99-aa97-436e-b5dc-d7a8aca1d28e service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:26.846888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff206b-0174-41c5-a8cb-c91c73d4e05e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:26.847679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff206b-0174-41c5-a8cb-c91c73d4e05e service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:26.848047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff206b-0174-41c5-a8cb-c91c73d4e05e service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:26.848516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ff206b-0174-41c5-a8cb-c91c73d4e05e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:26.865116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff206b-0174-41c5-a8cb-c91c73d4e05e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:26.866722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ff206b-0174-41c5-a8cb-c91c73d4e05e service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:26.880910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1195/2378] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:30.651671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d181-1f6f-4f38-96dd-665336d2d2eb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:30.652279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d181-1f6f-4f38-96dd-665336d2d2eb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:30.652372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0d181-1f6f-4f38-96dd-665336d2d2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:30.678866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c6e0d181-1f6f-4f38-96dd-665336d2d2eb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:30.680326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c6e0d181-1f6f-4f38-96dd-665336d2d2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:30.690349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1184/2379] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:30.715349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff206b-0174-41c5-a8cb-c91c73d4e05e service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:30.735478 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ff206b-0174-41c5-a8cb-c91c73d4e05e service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:30.748151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1580de5-bef6-45c1-94ab-13c80ca6fcec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:30.748937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580de5-bef6-45c1-94ab-13c80ca6fcec service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:30.749401 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580de5-bef6-45c1-94ab-13c80ca6fcec service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:30.749768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580de5-bef6-45c1-94ab-13c80ca6fcec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:30.760735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1580de5-bef6-45c1-94ab-13c80ca6fcec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:30.763224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1580de5-bef6-45c1-94ab-13c80ca6fcec service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:30.776101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1196/2380] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:33.689449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0d181-1f6f-4f38-96dd-665336d2d2eb None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:33.700234 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0d181-1f6f-4f38-96dd-665336d2d2eb None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:33.706047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:33.706684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:33.706972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:33.707243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] PATH_INFO: `/v3/users/2cffabc2d6764cbf9cab6147c7af3743` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:33.708520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cffabc2d6764cbf9cab6147c7af3743)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:33.710524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:33.765398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cffabc2d6764cbf9cab6147c7af3743'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:33.766177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cffabc2d6764cbf9cab6147c7af3743'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:33.774539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cffabc2d6764cbf9cab6147c7af3743'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:33.782914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cffabc2d6764cbf9cab6147c7af3743'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:33.783592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cffabc2d6764cbf9cab6147c7af3743'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:33.805746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1185/2381] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:39:33 2022] DELETE /identity/v3/users/2cffabc2d6764cbf9cab6147c7af3743 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:33.810272 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef0e0-12e9-4ced-87f4-afab45dcfa4a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:33.810767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef0e0-12e9-4ced-87f4-afab45dcfa4a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:33.810851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851ef0e0-12e9-4ced-87f4-afab45dcfa4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:33.830633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-851ef0e0-12e9-4ced-87f4-afab45dcfa4a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:33.831849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-851ef0e0-12e9-4ced-87f4-afab45dcfa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:33.893737 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1197/2382] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:33.903516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:33.905068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:33.920766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:33.967425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dc4c4-49ff-4333-9ae2-bf8b7dd2ac25 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:33.971302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:33.971916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:33.972192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:33.972460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:33.982115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:33.983931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:33.997102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1186/2383] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:34.248898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef0e0-12e9-4ced-87f4-afab45dcfa4a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:34.250821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-851ef0e0-12e9-4ced-87f4-afab45dcfa4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.263829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851ef0e0-12e9-4ced-87f4-afab45dcfa4a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:34.268622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:34.269271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.269593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.269921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] PATH_INFO: `/v3/users/871f7ccebdaa4791bb7ddb3f366360a1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.271837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=871f7ccebdaa4791bb7ddb3f366360a1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:34.274321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:34.329640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871f7ccebdaa4791bb7ddb3f366360a1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.330336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871f7ccebdaa4791bb7ddb3f366360a1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.339298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871f7ccebdaa4791bb7ddb3f366360a1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.345119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:34.359160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871f7ccebdaa4791bb7ddb3f366360a1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.360076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8ee8dd98-de7a-4e1f-897c-e239167d3c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871f7ccebdaa4791bb7ddb3f366360a1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.361223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:34.365628 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.381628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1198/2384] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:39:34 2022] DELETE /identity/v3/users/871f7ccebdaa4791bb7ddb3f366360a1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:34.386389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3670d-3980-4d70-8c2e-de434f3b74f1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.386876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3670d-3980-4d70-8c2e-de434f3b74f1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.387524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71019fe-4e0d-4eb4-a47f-a46127079a5f service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:34.396683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf3670d-3980-4d70-8c2e-de434f3b74f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.440256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-baf3670d-3980-4d70-8c2e-de434f3b74f1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:34.441766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-baf3670d-3980-4d70-8c2e-de434f3b74f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.478278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:34.479003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.479790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.480054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] PATH_INFO: `/v3/projects/71d1945e484548cfbdd09abced20d3cb` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.481486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d1945e484548cfbdd09abced20d3cb)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:34.484192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:34.518435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1199/2385] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:39:34.528922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3670d-3980-4d70-8c2e-de434f3b74f1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:34.530589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-baf3670d-3980-4d70-8c2e-de434f3b74f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.539169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d1945e484548cfbdd09abced20d3cb', 'request_id': 'req-e6c9e141-33f5-4a81-ba8f-d6628a741d12'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.546933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d1945e484548cfbdd09abced20d3cb', 'request_id': 'req-e6c9e141-33f5-4a81-ba8f-d6628a741d12'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.553692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d1945e484548cfbdd09abced20d3cb', 'request_id': 'req-e6c9e141-33f5-4a81-ba8f-d6628a741d12'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.572666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] The token cache is being invalidate because project 71d1945e484548cfbdd09abced20d3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:39:34.572979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.573650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-e6c9e141-33f5-4a81-ba8f-d6628a741d12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:34.575228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1187/2386] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:39:34 2022] DELETE /identity/v3/projects/71d1945e484548cfbdd09abced20d3cb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:34.580132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7e5c-d16a-448f-aee9-3392ef6c0912 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.580414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7e5c-d16a-448f-aee9-3392ef6c0912 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.580679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd7e5c-d16a-448f-aee9-3392ef6c0912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.603686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-52dd7e5c-d16a-448f-aee9-3392ef6c0912 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:34.605886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-52dd7e5c-d16a-448f-aee9-3392ef6c0912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.610237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf3670d-3980-4d70-8c2e-de434f3b74f1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:34.668835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:34.678250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:34.679277 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.679597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.680052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.681989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.691782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1188/2387] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:34.696148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:34.697598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:34.699910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374603a-ae74-489f-94a1-8442e9e2a2e9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.700259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374603a-ae74-489f-94a1-8442e9e2a2e9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.700593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374603a-ae74-489f-94a1-8442e9e2a2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.707163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1200/2388] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:39:34.720347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0374603a-ae74-489f-94a1-8442e9e2a2e9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:34.721653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0374603a-ae74-489f-94a1-8442e9e2a2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.729520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1189/2389] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:39:34.734302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:34.744438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d30e0f-a501-47e9-bd7d-f9cf1ead18f7 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:34.749891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:34.750555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.750832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.751101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.752146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:39:34.752446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:34.754357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:34.765835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170d315-aad7-4de3-b9ad-d02710c5f576 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.766417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170d315-aad7-4de3-b9ad-d02710c5f576 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.766924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170d315-aad7-4de3-b9ad-d02710c5f576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.775067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1201/2390] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:39:34.779714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:34.790792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c170d315-aad7-4de3-b9ad-d02710c5f576 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:34.791450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b392f7-b46d-4075-8688-b53823f823d6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:34.792636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c170d315-aad7-4de3-b9ad-d02710c5f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.798602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f023e-b925-4e0a-a961-e35f760f1dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:34.799470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f023e-b925-4e0a-a961-e35f760f1dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.799789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f023e-b925-4e0a-a961-e35f760f1dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.800066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f023e-b925-4e0a-a961-e35f760f1dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.800800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f023e-b925-4e0a-a961-e35f760f1dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:34.802854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1190/2391] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:39:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:34.802978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f023e-b925-4e0a-a961-e35f760f1dc1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:34.825158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:34.829193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170d315-aad7-4de3-b9ad-d02710c5f576 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:34.831067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c170d315-aad7-4de3-b9ad-d02710c5f576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:34.832396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1202/2392] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:39:34 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:39:34.836278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f023e-b925-4e0a-a961-e35f760f1dc1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:34.924809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170d315-aad7-4de3-b9ad-d02710c5f576 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:34.929361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f023e-b925-4e0a-a961-e35f760f1dc1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:34.935415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e531ac-fd9f-45a9-b9fc-e697ee482a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:34.936192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e531ac-fd9f-45a9-b9fc-e697ee482a36 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:34.937175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e531ac-fd9f-45a9-b9fc-e697ee482a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:34.937175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e531ac-fd9f-45a9-b9fc-e697ee482a36 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:34.937815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e531ac-fd9f-45a9-b9fc-e697ee482a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:34.940839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e531ac-fd9f-45a9-b9fc-e697ee482a36 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:34.966960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1203/2393] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:39:34 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:39:34.971573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e531ac-fd9f-45a9-b9fc-e697ee482a36 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:34.992273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e531ac-fd9f-45a9-b9fc-e697ee482a36 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.003346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.004473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.004738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.005122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.006164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.008273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.019429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f02837-e470-4c26-bb1b-168d6207598a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.020465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02837-e470-4c26-bb1b-168d6207598a service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.020927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02837-e470-4c26-bb1b-168d6207598a service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.021402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f02837-e470-4c26-bb1b-168d6207598a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.022331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1204/2394] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:39:35.024110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.026268 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:35.033782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f02837-e470-4c26-bb1b-168d6207598a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.035559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f02837-e470-4c26-bb1b-168d6207598a service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.042257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1077f5-478c-4fd3-bc20-76dc8025c85a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.045980 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1191/2395] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:35.046817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f02837-e470-4c26-bb1b-168d6207598a service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.047663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.048445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.048990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.049304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] PATH_INFO: `/v3/projects/962b0971f3034577809163b87f5db983` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.050676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=962b0971f3034577809163b87f5db983)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.052784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.056884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f02837-e470-4c26-bb1b-168d6207598a service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.061894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9eae-f86d-430f-a969-988f9cd45605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.062591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9eae-f86d-430f-a969-988f9cd45605 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.062933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9eae-f86d-430f-a969-988f9cd45605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.063746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb9eae-f86d-430f-a969-988f9cd45605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.063899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb9eae-f86d-430f-a969-988f9cd45605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.065616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb9eae-f86d-430f-a969-988f9cd45605 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.076878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1192/2396] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:39:35.081013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9eae-f86d-430f-a969-988f9cd45605 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.093968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb9eae-f86d-430f-a969-988f9cd45605 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.108078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '962b0971f3034577809163b87f5db983', 'request_id': 'req-0c0cde07-e178-4742-81b7-30bba72dfb9f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:35.115069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '962b0971f3034577809163b87f5db983', 'request_id': 'req-0c0cde07-e178-4742-81b7-30bba72dfb9f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:35.130394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '962b0971f3034577809163b87f5db983', 'request_id': 'req-0c0cde07-e178-4742-81b7-30bba72dfb9f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:35.137208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:35.143516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] The token cache is being invalidate because project 962b0971f3034577809163b87f5db983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:39:35.143832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:35.144460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0c0cde07-e178-4742-81b7-30bba72dfb9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:35.145983 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1205/2397] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:39:35 2022] DELETE /identity/v3/projects/962b0971f3034577809163b87f5db983 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:35.151050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f447a4-411e-4a2a-9817-b5d3e7af0e9e None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.151337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f447a4-411e-4a2a-9817-b5d3e7af0e9e None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.151638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f447a4-411e-4a2a-9817-b5d3e7af0e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.153365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67341471-8ffc-429e-8ada-c0b1cb2259b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.154067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341471-8ffc-429e-8ada-c0b1cb2259b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.154351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341471-8ffc-429e-8ada-c0b1cb2259b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.154624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67341471-8ffc-429e-8ada-c0b1cb2259b8 admin admin] PATH_INFO: `/v3/projects/34adcd1df6534cb9ba5c6a45c9fd662b/users/229f9f65d3c947e6964bd7e0408b365c/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.170126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67341471-8ffc-429e-8ada-c0b1cb2259b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34adcd1df6534cb9ba5c6a45c9fd662b, user_id=229f9f65d3c947e6964bd7e0408b365c, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.170887 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-57f447a4-411e-4a2a-9817-b5d3e7af0e9e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:35.172097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-57f447a4-411e-4a2a-9817-b5d3e7af0e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:35.173500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67341471-8ffc-429e-8ada-c0b1cb2259b8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.188348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1206/2398] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:39:35.189182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb68b-9514-42d0-8965-28837a1beaa9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.189846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1193/2399] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:39:35 2022] PUT /identity/v3/projects/34adcd1df6534cb9ba5c6a45c9fd662b/users/229f9f65d3c947e6964bd7e0408b365c/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:39:35.190052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb68b-9514-42d0-8965-28837a1beaa9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.198174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8feb68b-9514-42d0-8965-28837a1beaa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.199771 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703a65c-a1c9-45cd-aac5-4560796c8495 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.200110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703a65c-a1c9-45cd-aac5-4560796c8495 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.200383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8703a65c-a1c9-45cd-aac5-4560796c8495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.218551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a8feb68b-9514-42d0-8965-28837a1beaa9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:35.219756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a8feb68b-9514-42d0-8965-28837a1beaa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:35.231970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8703a65c-a1c9-45cd-aac5-4560796c8495 None None] MFA Rules not processed for user `229f9f65d3c947e6964bd7e0408b365c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:35.233298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8703a65c-a1c9-45cd-aac5-4560796c8495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:35.282244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:35.303985 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1207/2400] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:39:35.305154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb68b-9514-42d0-8965-28837a1beaa9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.318200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8feb68b-9514-42d0-8965-28837a1beaa9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.325029 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.325656 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.325963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.326232 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.327008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:39:35.327310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.330628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.335018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1194/2401] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:35.345836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1208/2402] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:39:35.349587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703a65c-a1c9-45cd-aac5-4560796c8495 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.357619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.359560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:35.386768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8703a65c-a1c9-45cd-aac5-4560796c8495 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.393334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133ae7e-dce0-430a-9d25-cf2b2d7c4bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.394129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133ae7e-dce0-430a-9d25-cf2b2d7c4bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.394129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133ae7e-dce0-430a-9d25-cf2b2d7c4bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.394406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133ae7e-dce0-430a-9d25-cf2b2d7c4bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.396092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133ae7e-dce0-430a-9d25-cf2b2d7c4bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.399494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133ae7e-dce0-430a-9d25-cf2b2d7c4bf8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.439280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1195/2403] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:39:35 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:39:35.440823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133ae7e-dce0-430a-9d25-cf2b2d7c4bf8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.456314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ad2e-0ed4-464a-9045-085e47869e10 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.528830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133ae7e-dce0-430a-9d25-cf2b2d7c4bf8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.541972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244adfd-e4c6-4f83-ad1d-fb51b3e06ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.543584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244adfd-e4c6-4f83-ad1d-fb51b3e06ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.544629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244adfd-e4c6-4f83-ad1d-fb51b3e06ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.545123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244adfd-e4c6-4f83-ad1d-fb51b3e06ad1 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.546385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244adfd-e4c6-4f83-ad1d-fb51b3e06ad1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.550572 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244adfd-e4c6-4f83-ad1d-fb51b3e06ad1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.558032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022f156-0d6e-458b-8025-97c578cfa357 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.558721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f156-0d6e-458b-8025-97c578cfa357 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.559000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f156-0d6e-458b-8025-97c578cfa357 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.559372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022f156-0d6e-458b-8025-97c578cfa357 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.588479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1196/2404] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:39:35 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:39:35.593466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244adfd-e4c6-4f83-ad1d-fb51b3e06ad1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.605510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244adfd-e4c6-4f83-ad1d-fb51b3e06ad1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.610830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137cf7-3a8b-49fa-9fe4-eb509108720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.611581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137cf7-3a8b-49fa-9fe4-eb509108720e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.611868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137cf7-3a8b-49fa-9fe4-eb509108720e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.612132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93137cf7-3a8b-49fa-9fe4-eb509108720e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.612784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93137cf7-3a8b-49fa-9fe4-eb509108720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.614682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93137cf7-3a8b-49fa-9fe4-eb509108720e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.629327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1197/2405] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:39:35.630752 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137cf7-3a8b-49fa-9fe4-eb509108720e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.642028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93137cf7-3a8b-49fa-9fe4-eb509108720e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.642422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022f156-0d6e-458b-8025-97c578cfa357 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.644032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022f156-0d6e-458b-8025-97c578cfa357 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.647278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154c61e-da44-4050-9d78-b4aebbf45048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.647898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c61e-da44-4050-9d78-b4aebbf45048 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.648178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c61e-da44-4050-9d78-b4aebbf45048 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.648448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154c61e-da44-4050-9d78-b4aebbf45048 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.649099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c61e-da44-4050-9d78-b4aebbf45048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.650738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154c61e-da44-4050-9d78-b4aebbf45048 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.655062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1209/2406] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:39:35.665066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1198/2407] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:39:35.674002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022f156-0d6e-458b-8025-97c578cfa357 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:35.696474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022f156-0d6e-458b-8025-97c578cfa357 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:35.701363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f453b-591e-4927-8cee-62b94f95ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:35.702072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f453b-591e-4927-8cee-62b94f95ebb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.702363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f453b-591e-4927-8cee-62b94f95ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.702625 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f453b-591e-4927-8cee-62b94f95ebb0 admin admin] PATH_INFO: `/v3/projects/3ca751dfa61c436ba1c4fb016e2a3119/users/e9f95bcae95746ecbb295d627a26a53b/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.720649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f453b-591e-4927-8cee-62b94f95ebb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ca751dfa61c436ba1c4fb016e2a3119, user_id=e9f95bcae95746ecbb295d627a26a53b, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:35.723715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f453b-591e-4927-8cee-62b94f95ebb0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:35.741164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1210/2408] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:39:35 2022] PUT /identity/v3/projects/3ca751dfa61c436ba1c4fb016e2a3119/users/e9f95bcae95746ecbb295d627a26a53b/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:35.751255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb64d-b9e9-4220-bcac-d7294a1c1d63 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:35.752142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb64d-b9e9-4220-bcac-d7294a1c1d63 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:35.752243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb64d-b9e9-4220-bcac-d7294a1c1d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:35.759284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:35.912301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-4c3eb64d-b9e9-4220-bcac-d7294a1c1d63 None None] MFA Rules not processed for user `e9f95bcae95746ecbb295d627a26a53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:35.913780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4c3eb64d-b9e9-4220-bcac-d7294a1c1d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:35.996340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1199/2409] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:36.009030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f453b-591e-4927-8cee-62b94f95ebb0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:36.041572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:36.067782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f453b-591e-4927-8cee-62b94f95ebb0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:36.071436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62de233-c5b9-4cb9-81b9-77beb6367723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:36.072039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de233-c5b9-4cb9-81b9-77beb6367723 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:36.072316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de233-c5b9-4cb9-81b9-77beb6367723 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:36.072587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62de233-c5b9-4cb9-81b9-77beb6367723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:36.080717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62de233-c5b9-4cb9-81b9-77beb6367723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:36.082195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62de233-c5b9-4cb9-81b9-77beb6367723 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:36.091169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1211/2410] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:37.078465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6892e-3005-4c0d-a038-ef32a16ed62f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.079013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6892e-3005-4c0d-a038-ef32a16ed62f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.079013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6892e-3005-4c0d-a038-ef32a16ed62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.100077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-61a6892e-3005-4c0d-a038-ef32a16ed62f None None] MFA Rules not processed for user `229f9f65d3c947e6964bd7e0408b365c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:37.100077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-61a6892e-3005-4c0d-a038-ef32a16ed62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:37.154729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1200/2411] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:37.285381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906f48d-e347-4ff3-b21a-8988dda80795 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.285977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906f48d-e347-4ff3-b21a-8988dda80795 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.285977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906f48d-e347-4ff3-b21a-8988dda80795 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.287627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1212/2412] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:39:37.295293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd4d9-a042-4f5f-9ba4-662aa3cd34a5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.295550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd4d9-a042-4f5f-9ba4-662aa3cd34a5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.295813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fd4d9-a042-4f5f-9ba4-662aa3cd34a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.317223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c17fd4d9-a042-4f5f-9ba4-662aa3cd34a5 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:37.318505 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c17fd4d9-a042-4f5f-9ba4-662aa3cd34a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:37.398328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1201/2413] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:39:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:37.411267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906f48d-e347-4ff3-b21a-8988dda80795 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:37.414318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9906f48d-e347-4ff3-b21a-8988dda80795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:37.502072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906f48d-e347-4ff3-b21a-8988dda80795 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:37.506240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32769f1-bfa5-49ea-860f-92be4bd03194 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46c91e383f44555b753b6500c9cdc44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:37.507074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32769f1-bfa5-49ea-860f-92be4bd03194 service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.507420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32769f1-bfa5-49ea-860f-92be4bd03194 service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.507759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32769f1-bfa5-49ea-860f-92be4bd03194 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.520328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32769f1-bfa5-49ea-860f-92be4bd03194 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:37.521906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32769f1-bfa5-49ea-860f-92be4bd03194 service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:37.533570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1213/2414] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:37.620523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409f13-0ec1-4378-97b1-3e09a30b6a28 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.620852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409f13-0ec1-4378-97b1-3e09a30b6a28 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.621146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33409f13-0ec1-4378-97b1-3e09a30b6a28 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.622780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1202/2415] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:39:37.632126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e114-c531-42d9-b889-b837929fb98a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.632552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e114-c531-42d9-b889-b837929fb98a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.633536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e114-c531-42d9-b889-b837929fb98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.666819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7921e114-c531-42d9-b889-b837929fb98a None None] MFA Rules not processed for user `18061b868be44122a849e2e239b56f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:37.669065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7921e114-c531-42d9-b889-b837929fb98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:37.745159 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1214/2416] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:39:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:37.771934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33409f13-0ec1-4378-97b1-3e09a30b6a28 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:37.774891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-33409f13-0ec1-4378-97b1-3e09a30b6a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:37.799182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33409f13-0ec1-4378-97b1-3e09a30b6a28 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:37.806326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5deaa0-a356-4ae0-8c68-5f80ef17d3b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:37.808096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5deaa0-a356-4ae0-8c68-5f80ef17d3b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.808096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5deaa0-a356-4ae0-8c68-5f80ef17d3b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.808096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5deaa0-a356-4ae0-8c68-5f80ef17d3b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.816593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5deaa0-a356-4ae0-8c68-5f80ef17d3b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:37.818158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5deaa0-a356-4ae0-8c68-5f80ef17d3b4 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:37.827385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1203/2417] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:37.916984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d64e-4baf-4e14-a86a-ea42a317c469 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.917268 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d64e-4baf-4e14-a86a-ea42a317c469 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.917537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d64e-4baf-4e14-a86a-ea42a317c469 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.918918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1215/2418] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:39:37.924554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ae6f1-a0b2-4ebf-a036-059e8939f6f5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.924899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ae6f1-a0b2-4ebf-a036-059e8939f6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.925173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ae6f1-a0b2-4ebf-a036-059e8939f6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:37.945486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0e7ae6f1-a0b2-4ebf-a036-059e8939f6f5 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:37.946947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0e7ae6f1-a0b2-4ebf-a036-059e8939f6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:37.957308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1204/2419] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:39:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:39:37.971473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660d64e-4baf-4e14-a86a-ea42a317c469 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:37.993434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660d64e-4baf-4e14-a86a-ea42a317c469 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:37.997733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:37.999047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:37.999047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:37.999047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:38.011316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:38.012765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:38.033668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1216/2420] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:38.968876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb259-cea5-4120-835e-9f72adbe8262 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:38.969409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb259-cea5-4120-835e-9f72adbe8262 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:38.969409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbb259-cea5-4120-835e-9f72adbe8262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:38.997706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-7bbbb259-cea5-4120-835e-9f72adbe8262 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:38.998957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7bbbb259-cea5-4120-835e-9f72adbe8262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:39.003945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:39.059034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1205/2421] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:39:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:39.082055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:39.083531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:39.100092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232d7ae-425d-4916-bd41-cce2b26c259f service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:39.105588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695d984-7543-4562-b3f5-b8cc823b2527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:39.106222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695d984-7543-4562-b3f5-b8cc823b2527 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:39.106547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695d984-7543-4562-b3f5-b8cc823b2527 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:39.106758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695d984-7543-4562-b3f5-b8cc823b2527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:39.115905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695d984-7543-4562-b3f5-b8cc823b2527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:39.117577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695d984-7543-4562-b3f5-b8cc823b2527 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:39.129872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1217/2422] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:42.143225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606d2c7-0370-4dbf-a5e7-d310e7b5a18b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:42.143780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606d2c7-0370-4dbf-a5e7-d310e7b5a18b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:42.143780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2606d2c7-0370-4dbf-a5e7-d310e7b5a18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:42.163626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2606d2c7-0370-4dbf-a5e7-d310e7b5a18b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:42.164846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2606d2c7-0370-4dbf-a5e7-d310e7b5a18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:42.174633 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1206/2423] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:42.267110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695d984-7543-4562-b3f5-b8cc823b2527 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:42.278892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695d984-7543-4562-b3f5-b8cc823b2527 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:42.284565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:42.285184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:42.285458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:42.285725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:42.294672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:42.296352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:42.307327 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1218/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:46.320612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe35c85-7a54-4edc-8a93-a5d5eaa9b6a0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:46.321520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe35c85-7a54-4edc-8a93-a5d5eaa9b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:46.321963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe35c85-7a54-4edc-8a93-a5d5eaa9b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:46.342141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cbe35c85-7a54-4edc-8a93-a5d5eaa9b6a0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:46.343600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cbe35c85-7a54-4edc-8a93-a5d5eaa9b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:46.352927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1207/2425] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:46.375339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:46.377492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:46.392872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac3905-fac1-4fa4-beb3-90e1fae29af5 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:46.398844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44089b2a-53d1-4f5f-81ed-95064ffe57b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:46.399465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44089b2a-53d1-4f5f-81ed-95064ffe57b4 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:46.399740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44089b2a-53d1-4f5f-81ed-95064ffe57b4 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:46.400022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44089b2a-53d1-4f5f-81ed-95064ffe57b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:46.408777 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44089b2a-53d1-4f5f-81ed-95064ffe57b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:46.410503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44089b2a-53d1-4f5f-81ed-95064ffe57b4 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:46.420354 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1219/2426] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:46.552360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe35c85-7a54-4edc-8a93-a5d5eaa9b6a0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:46.562719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe35c85-7a54-4edc-8a93-a5d5eaa9b6a0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:46.568563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:46.569194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:46.569467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:46.569733 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] PATH_INFO: `/v3/users/e9f95bcae95746ecbb295d627a26a53b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:46.571106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9f95bcae95746ecbb295d627a26a53b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:46.573056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:46.622042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9f95bcae95746ecbb295d627a26a53b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:46.622692 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9f95bcae95746ecbb295d627a26a53b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:46.631495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9f95bcae95746ecbb295d627a26a53b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:46.638549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9f95bcae95746ecbb295d627a26a53b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:46.639173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9f95bcae95746ecbb295d627a26a53b'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:46.657102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1208/2427] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:39:46 2022] DELETE /identity/v3/users/e9f95bcae95746ecbb295d627a26a53b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:46.661834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fb37e-c087-4633-a598-08f000e1ce56 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:46.662119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fb37e-c087-4633-a598-08f000e1ce56 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:46.662387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357fb37e-c087-4633-a598-08f000e1ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:46.682492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-357fb37e-c087-4633-a598-08f000e1ce56 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:46.683695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-357fb37e-c087-4633-a598-08f000e1ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:46.710668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:46.753085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1220/2428] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:46.778872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:46.780468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:46.848808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572a248-045d-4d62-98de-22a47cbde46c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:46.852830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89e56aa-e4e8-494b-9d0e-56f6a2d46790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:46.853478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e56aa-e4e8-494b-9d0e-56f6a2d46790 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:46.853708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e56aa-e4e8-494b-9d0e-56f6a2d46790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:46.854053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89e56aa-e4e8-494b-9d0e-56f6a2d46790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:46.865326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e56aa-e4e8-494b-9d0e-56f6a2d46790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:46.866889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89e56aa-e4e8-494b-9d0e-56f6a2d46790 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:46.878876 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1209/2429] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:39:47.302899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fb37e-c087-4633-a598-08f000e1ce56 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:47.304392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-357fb37e-c087-4633-a598-08f000e1ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:47.350756 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357fb37e-c087-4633-a598-08f000e1ce56 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:47.356056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:47.356709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.356984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.357249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] PATH_INFO: `/v3/projects/3ca751dfa61c436ba1c4fb016e2a3119` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.358466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ca751dfa61c436ba1c4fb016e2a3119)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:47.361003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:47.410873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ca751dfa61c436ba1c4fb016e2a3119', 'request_id': 'req-55845a51-c3d6-4fc1-9432-9915c193a15f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:47.417062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ca751dfa61c436ba1c4fb016e2a3119', 'request_id': 'req-55845a51-c3d6-4fc1-9432-9915c193a15f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:47.425217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ca751dfa61c436ba1c4fb016e2a3119', 'request_id': 'req-55845a51-c3d6-4fc1-9432-9915c193a15f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:47.436803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] The token cache is being invalidate because project 3ca751dfa61c436ba1c4fb016e2a3119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:39:47.437092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:47.437814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-55845a51-c3d6-4fc1-9432-9915c193a15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:39:47.439304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1221/2430] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:39:47 2022] DELETE /identity/v3/projects/3ca751dfa61c436ba1c4fb016e2a3119 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:47.444990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fcb08-1361-4f50-91b2-3dfe4a99d155 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.445596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fcb08-1361-4f50-91b2-3dfe4a99d155 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.445596 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578fcb08-1361-4f50-91b2-3dfe4a99d155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.465213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-578fcb08-1361-4f50-91b2-3dfe4a99d155 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:47.468056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-578fcb08-1361-4f50-91b2-3dfe4a99d155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:47.477807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:47.532844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1210/2431] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:47.540914 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ad7e3-f17d-4543-bf92-3103304a2a37 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.541451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ad7e3-f17d-4543-bf92-3103304a2a37 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.541717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ad7e3-f17d-4543-bf92-3103304a2a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.564822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-646ad7e3-f17d-4543-bf92-3103304a2a37 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:47.567149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-646ad7e3-f17d-4543-bf92-3103304a2a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:47.575878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1222/2432] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:47.580049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fcb08-1361-4f50-91b2-3dfe4a99d155 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:47.589984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578fcb08-1361-4f50-91b2-3dfe4a99d155 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:47.594573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:47.595407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.595686 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.595956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.596602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:39:47.596901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:47.598568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:47.610082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1211/2433] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:39:47.614910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ad7e3-f17d-4543-bf92-3103304a2a37 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:47.624262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ad7e3-f17d-4543-bf92-3103304a2a37 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:47.629158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1b440-442d-4d48-9246-5be4ee4000f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:47.629772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1b440-442d-4d48-9246-5be4ee4000f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.630050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1b440-442d-4d48-9246-5be4ee4000f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.630316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1b440-442d-4d48-9246-5be4ee4000f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.630938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1b440-442d-4d48-9246-5be4ee4000f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:47.632821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1b440-442d-4d48-9246-5be4ee4000f8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:47.664645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1223/2434] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:39:47 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:39:47.666437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:47.676656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285c1e8-2a2c-40cc-a0d9-0ab3d6d3ac2b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:47.734710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73d6d2-12b3-4025-b574-ceaecd18ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:47.735324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73d6d2-12b3-4025-b574-ceaecd18ff2a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.735604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73d6d2-12b3-4025-b574-ceaecd18ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.735867 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73d6d2-12b3-4025-b574-ceaecd18ff2a admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.736494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73d6d2-12b3-4025-b574-ceaecd18ff2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:47.738479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73d6d2-12b3-4025-b574-ceaecd18ff2a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:47.762606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1212/2435] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:39:47 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:39:47.767038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1b440-442d-4d48-9246-5be4ee4000f8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:47.777417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1b440-442d-4d48-9246-5be4ee4000f8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:47.782135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ea94-3f87-43e2-a2da-9cefc4200e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:47.782727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ea94-3f87-43e2-a2da-9cefc4200e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.783003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ea94-3f87-43e2-a2da-9cefc4200e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.783270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ea94-3f87-43e2-a2da-9cefc4200e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.783907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317ea94-3f87-43e2-a2da-9cefc4200e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:47.785499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317ea94-3f87-43e2-a2da-9cefc4200e8b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:47.795846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1224/2436] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:39:47.799998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73d6d2-12b3-4025-b574-ceaecd18ff2a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:47.810149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73d6d2-12b3-4025-b574-ceaecd18ff2a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:47.815915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5093c-3441-4e79-ad68-7e0f21e10505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:47.816509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5093c-3441-4e79-ad68-7e0f21e10505 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.816782 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5093c-3441-4e79-ad68-7e0f21e10505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.817040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5093c-3441-4e79-ad68-7e0f21e10505 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.817675 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5093c-3441-4e79-ad68-7e0f21e10505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:47.819355 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5093c-3441-4e79-ad68-7e0f21e10505 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:47.830353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1213/2437] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:39:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:39:47.834714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ea94-3f87-43e2-a2da-9cefc4200e8b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:47.845346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ea94-3f87-43e2-a2da-9cefc4200e8b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:47.851157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:47.851800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.852077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.852335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] PATH_INFO: `/v3/projects/beef0d51792b46b586acd4b152b7fc9f/users/003520607376412ea5e0fd7faab392d1/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.867856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beef0d51792b46b586acd4b152b7fc9f, user_id=003520607376412ea5e0fd7faab392d1, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:47.870600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:47.886883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1225/2438] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:39:47 2022] PUT /identity/v3/projects/beef0d51792b46b586acd4b152b7fc9f/users/003520607376412ea5e0fd7faab392d1/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:47.891979 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384abde-8f30-490a-acb0-2511fae57ef5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:47.892264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384abde-8f30-490a-acb0-2511fae57ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:47.892530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d384abde-8f30-490a-acb0-2511fae57ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:47.912256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d384abde-8f30-490a-acb0-2511fae57ef5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:47.913462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d384abde-8f30-490a-acb0-2511fae57ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:47.977198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1214/2439] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:47.987155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:47.989063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:48.047851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f987ae4-bf60-42db-9475-d3bac7007260 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:48.051669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60016928-0ddb-427f-94b0-0e22735953cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:48.052289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016928-0ddb-427f-94b0-0e22735953cb service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:48.052563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016928-0ddb-427f-94b0-0e22735953cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:48.052834 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60016928-0ddb-427f-94b0-0e22735953cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:48.058808 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:48.062964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016928-0ddb-427f-94b0-0e22735953cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:48.064861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60016928-0ddb-427f-94b0-0e22735953cb service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:48.076431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1226/2440] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:39:48.331557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384abde-8f30-490a-acb0-2511fae57ef5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:48.347487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d384abde-8f30-490a-acb0-2511fae57ef5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:48.353942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:48.356198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:48.356768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:48.357240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:48.359322 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:48.391162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:48.457562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:48.460404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:48.472808 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1215/2441] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:39:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:39:54.208803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8ee8-830c-4325-9793-74d3ca2225c2 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.209678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8ee8-830c-4325-9793-74d3ca2225c2 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.210005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a8ee8-830c-4325-9793-74d3ca2225c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.265571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a35a8ee8-830c-4325-9793-74d3ca2225c2 None None] MFA Rules not processed for user `003520607376412ea5e0fd7faab392d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:54.266972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a35a8ee8-830c-4325-9793-74d3ca2225c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:54.358788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1227/2442] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:39:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:39:54.363859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:54.371563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2103-7e7c-4ee4-bcc7-9e3c4b841d19 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.371847 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2103-7e7c-4ee4-bcc7-9e3c4b841d19 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.372283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c2103-7e7c-4ee4-bcc7-9e3c4b841d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.382244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35d137f-1cf9-485b-893d-076bb78cfdd1 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:54.389513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67459b-4129-49e0-8fd5-f5135a9023d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:54.390394 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67459b-4129-49e0-8fd5-f5135a9023d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.390838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67459b-4129-49e0-8fd5-f5135a9023d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.391277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67459b-4129-49e0-8fd5-f5135a9023d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.391929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67459b-4129-49e0-8fd5-f5135a9023d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:54.394206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa67459b-4129-49e0-8fd5-f5135a9023d6 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:54.426524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d00c2103-7e7c-4ee4-bcc7-9e3c4b841d19 None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:39:54.428341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d00c2103-7e7c-4ee4-bcc7-9e3c4b841d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:54.448698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1216/2443] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:39:54 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:39:54.452331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67459b-4129-49e0-8fd5-f5135a9023d6 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:54.505302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1228/2444] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:39:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:39:54.521940 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c2103-7e7c-4ee4-bcc7-9e3c4b841d19 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:54.525779 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d00c2103-7e7c-4ee4-bcc7-9e3c4b841d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:39:54.562287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa67459b-4129-49e0-8fd5-f5135a9023d6 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:54.568497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7807b7-e14f-426f-98f5-6268c7820580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:54.569126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7807b7-e14f-426f-98f5-6268c7820580 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.569409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7807b7-e14f-426f-98f5-6268c7820580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.569682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7807b7-e14f-426f-98f5-6268c7820580 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.570364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7807b7-e14f-426f-98f5-6268c7820580 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:54.572413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7807b7-e14f-426f-98f5-6268c7820580 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:54.601302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1217/2445] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:39:54 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:39:54.604481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7807b7-e14f-426f-98f5-6268c7820580 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:54.607591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c2103-7e7c-4ee4-bcc7-9e3c4b841d19 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:54.618002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7807b7-e14f-426f-98f5-6268c7820580 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:54.625343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770bc17-468b-4d16-a8b7-4a5f58e4ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:54.625343 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bc17-468b-4d16-a8b7-4a5f58e4ed02 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.625695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bc17-468b-4d16-a8b7-4a5f58e4ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.625881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5770bc17-468b-4d16-a8b7-4a5f58e4ed02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.627177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770bc17-468b-4d16-a8b7-4a5f58e4ed02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:54.628945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5770bc17-468b-4d16-a8b7-4a5f58e4ed02 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:54.646701 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1218/2446] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:39:54.647626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770bc17-468b-4d16-a8b7-4a5f58e4ed02 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:54.662627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5770bc17-468b-4d16-a8b7-4a5f58e4ed02 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:54.669842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f4bb6-733a-4ddc-88d3-e5dccd4640be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:54.670913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4bb6-733a-4ddc-88d3-e5dccd4640be admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.671071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4bb6-733a-4ddc-88d3-e5dccd4640be admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.671419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4bb6-733a-4ddc-88d3-e5dccd4640be admin admin] PATH_INFO: `/v3/projects/773571224d2942b9adebe4f3594acc87/users/ab0cb994c5ee4df894680b0475917809/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.688931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:54.694298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f4bb6-733a-4ddc-88d3-e5dccd4640be admin admin] RBAC: Authorizing `identity:create_grant(project_id=773571224d2942b9adebe4f3594acc87, user_id=ab0cb994c5ee4df894680b0475917809, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:54.697620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f4bb6-733a-4ddc-88d3-e5dccd4640be admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:54.724271 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1219/2447] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:39:54 2022] PUT /identity/v3/projects/773571224d2942b9adebe4f3594acc87/users/ab0cb994c5ee4df894680b0475917809/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:39:54.728179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f4bb6-733a-4ddc-88d3-e5dccd4640be admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:54.799128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:39:54.813868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623113c-87da-4077-adb0-9f9462b251e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:54.813868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623113c-87da-4077-adb0-9f9462b251e6 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.813868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623113c-87da-4077-adb0-9f9462b251e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.813868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623113c-87da-4077-adb0-9f9462b251e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.841165 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f4bb6-733a-4ddc-88d3-e5dccd4640be admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:54.847645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc89e8-fd10-481c-84e1-7bb74e06d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:54.848361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc89e8-fd10-481c-84e1-7bb74e06d5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.848643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc89e8-fd10-481c-84e1-7bb74e06d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.848981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc89e8-fd10-481c-84e1-7bb74e06d5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.849639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc89e8-fd10-481c-84e1-7bb74e06d5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:54.854653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc89e8-fd10-481c-84e1-7bb74e06d5c2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:54.869113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1220/2448] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:39:54.872556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc89e8-fd10-481c-84e1-7bb74e06d5c2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:39:54.893168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623113c-87da-4077-adb0-9f9462b251e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:54.895824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623113c-87da-4077-adb0-9f9462b251e6 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:54.896952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc89e8-fd10-481c-84e1-7bb74e06d5c2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:39:54.905816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1229/2449] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:39:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 03:39:54.906813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89411c-ea77-4c4f-b2bc-161e0cdfd095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:39:54.907918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89411c-ea77-4c4f-b2bc-161e0cdfd095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:39:54.908190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89411c-ea77-4c4f-b2bc-161e0cdfd095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:39:54.908334 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89411c-ea77-4c4f-b2bc-161e0cdfd095 admin admin] PATH_INFO: `/v3/projects/773571224d2942b9adebe4f3594acc87/users/ab0cb994c5ee4df894680b0475917809/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:39:54.911297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89411c-ea77-4c4f-b2bc-161e0cdfd095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773571224d2942b9adebe4f3594acc87, user_id=ab0cb994c5ee4df894680b0475917809, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:39:54.914424 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89411c-ea77-4c4f-b2bc-161e0cdfd095 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:39:54.929079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1221/2450] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:39:54 2022] PUT /identity/v3/projects/773571224d2942b9adebe4f3594acc87/users/ab0cb994c5ee4df894680b0475917809/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:40:01.014693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a2a1-13a5-4501-a3ca-833bc05aeb4b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:01.015229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a2a1-13a5-4501-a3ca-833bc05aeb4b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:01.015229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9a2a1-13a5-4501-a3ca-833bc05aeb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:01.035058 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-88d9a2a1-13a5-4501-a3ca-833bc05aeb4b None None] MFA Rules not processed for user `2dbc066c60a747cf99de32f5678c284f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:01.036283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-88d9a2a1-13a5-4501-a3ca-833bc05aeb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:01.113997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1230/2451] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:40:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:02.786862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250368f1-83d5-4dd7-8042-dc78ac354254 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:02.787398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250368f1-83d5-4dd7-8042-dc78ac354254 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:02.787398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250368f1-83d5-4dd7-8042-dc78ac354254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:02.855677 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-250368f1-83d5-4dd7-8042-dc78ac354254 None None] MFA Rules not processed for user `ab0cb994c5ee4df894680b0475917809`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:02.861618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-250368f1-83d5-4dd7-8042-dc78ac354254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:03.028930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1222/2452] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:40:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:03.045205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9a2a1-13a5-4501-a3ca-833bc05aeb4b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:03.046716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-88d9a2a1-13a5-4501-a3ca-833bc05aeb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:03.155578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9a2a1-13a5-4501-a3ca-833bc05aeb4b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:03.170811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8045f9-8e23-498a-9949-72e26ec6f054 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c46c91e383f44555b753b6500c9cdc44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:03.171646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8045f9-8e23-498a-9949-72e26ec6f054 service glance] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:03.172104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8045f9-8e23-498a-9949-72e26ec6f054 service glance] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:03.172630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8045f9-8e23-498a-9949-72e26ec6f054 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:03.214900 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:40:03.245223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8045f9-8e23-498a-9949-72e26ec6f054 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:03.247103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8045f9-8e23-498a-9949-72e26ec6f054 service glance] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:03.272346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1231/2453] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:40:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:40:03.455363 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec489875-4d57-49a9-b6e8-bc8d8a69b68c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:03.455645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec489875-4d57-49a9-b6e8-bc8d8a69b68c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:03.455911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec489875-4d57-49a9-b6e8-bc8d8a69b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:03.479042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ec489875-4d57-49a9-b6e8-bc8d8a69b68c None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:03.480654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ec489875-4d57-49a9-b6e8-bc8d8a69b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:03.540429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1223/2454] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:40:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:03.552871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8045f9-8e23-498a-9949-72e26ec6f054 service glance] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:03.637762 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8045f9-8e23-498a-9949-72e26ec6f054 service glance] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:03.642964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:03.643599 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:03.643935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:03.644194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:03.661134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:03.662813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:03.692349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1232/2455] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:40:13.533652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=73,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:40:13.688521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=45 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:40:16.074026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385b15-d49d-4a42-ab5d-acd12086bdc9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:16.074668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385b15-d49d-4a42-ab5d-acd12086bdc9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:16.074668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5385b15-d49d-4a42-ab5d-acd12086bdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:16.095166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a5385b15-d49d-4a42-ab5d-acd12086bdc9 None None] MFA Rules not processed for user `003520607376412ea5e0fd7faab392d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:16.096399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a5385b15-d49d-4a42-ab5d-acd12086bdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:16.105695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1224/2456] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:40:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:18.879871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:18.881796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:18.966236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fb39d-b3a8-401c-ab90-370827f9f15e service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:18.971244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:18.971989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:18.972251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:18.972517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:18.974313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:18.987877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:18.989509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:19.001550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1233/2457] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:40:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:40:20.182547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d759b76-1494-4643-a1d4-448bee619cbe None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:20.183118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d759b76-1494-4643-a1d4-448bee619cbe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:20.183118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d759b76-1494-4643-a1d4-448bee619cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:20.202734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8d759b76-1494-4643-a1d4-448bee619cbe None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:20.203937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8d759b76-1494-4643-a1d4-448bee619cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:20.211187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1225/2458] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:40:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:20.239958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:20.254921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6fc5-440a-4b57-90b8-989af6486dc2 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:20.261836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73bc7db-7d9b-4e05-b7f8-1c1e97d73ab0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:20.262456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc7db-7d9b-4e05-b7f8-1c1e97d73ab0 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:20.262730 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc7db-7d9b-4e05-b7f8-1c1e97d73ab0 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:20.263180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73bc7db-7d9b-4e05-b7f8-1c1e97d73ab0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:20.273204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bc7db-7d9b-4e05-b7f8-1c1e97d73ab0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:20.274835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73bc7db-7d9b-4e05-b7f8-1c1e97d73ab0 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:20.283338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1234/2459] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:40:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:40:23.094650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4de42-2cad-4f30-9a92-522289f52e4e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:23.095209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4de42-2cad-4f30-9a92-522289f52e4e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:23.095209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4de42-2cad-4f30-9a92-522289f52e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:23.114592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-bde4de42-2cad-4f30-9a92-522289f52e4e None None] MFA Rules not processed for user `b54c8bd4b1b748a69f8b942c34ab9abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:23.115848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-bde4de42-2cad-4f30-9a92-522289f52e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:23.172792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1226/2460] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:40:23 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:30.280183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=38 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:40:33.168117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=31 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:40:33.313157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3be4-00e0-4d77-84e1-aa0f10c93dab None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:33.313675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3be4-00e0-4d77-84e1-aa0f10c93dab None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:33.313675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3be4-00e0-4d77-84e1-aa0f10c93dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:33.334151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-f3cc3be4-00e0-4d77-84e1-aa0f10c93dab None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:33.335487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f3cc3be4-00e0-4d77-84e1-aa0f10c93dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:33.343482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1235/2461] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:40:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:33.356169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4de42-2cad-4f30-9a92-522289f52e4e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:33.371458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4de42-2cad-4f30-9a92-522289f52e4e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:33.377882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1d0fc-0bd2-4895-8df3-404c2cd5c206 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:33.378512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1d0fc-0bd2-4895-8df3-404c2cd5c206 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:33.378792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1d0fc-0bd2-4895-8df3-404c2cd5c206 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:33.379065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f1d0fc-0bd2-4895-8df3-404c2cd5c206 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:33.388436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1d0fc-0bd2-4895-8df3-404c2cd5c206 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:33.390093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f1d0fc-0bd2-4895-8df3-404c2cd5c206 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:33.398377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1227/2462] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:40:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:40:34.087824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da928adf-4f13-4241-91ad-423650600bff None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:34.088257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da928adf-4f13-4241-91ad-423650600bff None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:34.088618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da928adf-4f13-4241-91ad-423650600bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:34.110130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-da928adf-4f13-4241-91ad-423650600bff None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:34.111341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-da928adf-4f13-4241-91ad-423650600bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:34.118771 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1236/2463] 10.222.0.48 () {58 vars in 967 bytes} [Sat Sep 17 03:40:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:34.135707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1d0fc-0bd2-4895-8df3-404c2cd5c206 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:34.146568 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f1d0fc-0bd2-4895-8df3-404c2cd5c206 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:34.151700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11e4d7-0322-4ba5-9177-6c45c478b44c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:34.152474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11e4d7-0322-4ba5-9177-6c45c478b44c service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:34.152820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11e4d7-0322-4ba5-9177-6c45c478b44c service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:34.153182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc11e4d7-0322-4ba5-9177-6c45c478b44c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:34.161899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11e4d7-0322-4ba5-9177-6c45c478b44c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:34.163559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc11e4d7-0322-4ba5-9177-6c45c478b44c service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:34.172162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1228/2464] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:40:34.356828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648cd8-92da-4a15-89d4-0afe3a1b11ca None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:34.357791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648cd8-92da-4a15-89d4-0afe3a1b11ca None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:34.358408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b648cd8-92da-4a15-89d4-0afe3a1b11ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:34.382278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1b648cd8-92da-4a15-89d4-0afe3a1b11ca None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:34.383504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1b648cd8-92da-4a15-89d4-0afe3a1b11ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:34.390691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1237/2465] 10.222.0.48 () {58 vars in 967 bytes} [Sat Sep 17 03:40:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:34.405211 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11e4d7-0322-4ba5-9177-6c45c478b44c service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:34.416511 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc11e4d7-0322-4ba5-9177-6c45c478b44c service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:34.424439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4c8da-35f8-4cb8-bf99-12c3ec93a8f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:34.425281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4c8da-35f8-4cb8-bf99-12c3ec93a8f6 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:34.425561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4c8da-35f8-4cb8-bf99-12c3ec93a8f6 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:34.425933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4c8da-35f8-4cb8-bf99-12c3ec93a8f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:34.436399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4c8da-35f8-4cb8-bf99-12c3ec93a8f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:34.438055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4c8da-35f8-4cb8-bf99-12c3ec93a8f6 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:34.453843 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1229/2466] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:40:34.514920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346578-f784-484f-ae01-79fe6f1ee708 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:34.515205 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346578-f784-484f-ae01-79fe6f1ee708 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:34.515473 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc346578-f784-484f-ae01-79fe6f1ee708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:34.537370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-fc346578-f784-484f-ae01-79fe6f1ee708 None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:34.538881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-fc346578-f784-484f-ae01-79fe6f1ee708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:34.547078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1238/2467] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:40:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:40:34.559791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4c8da-35f8-4cb8-bf99-12c3ec93a8f6 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:34.571001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4c8da-35f8-4cb8-bf99-12c3ec93a8f6 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:34.577510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aad26-b520-4731-9f1b-f2ec17bcae5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:34.578291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aad26-b520-4731-9f1b-f2ec17bcae5a service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:34.578632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aad26-b520-4731-9f1b-f2ec17bcae5a service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:34.579155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7aad26-b520-4731-9f1b-f2ec17bcae5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:34.588454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aad26-b520-4731-9f1b-f2ec17bcae5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:34.590325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7aad26-b520-4731-9f1b-f2ec17bcae5a service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:34.600197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1230/2468] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:40:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:40:35.023208 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31929fcf-5722-4f5a-9409-cbe6f1ef81f8 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:35.024552 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31929fcf-5722-4f5a-9409-cbe6f1ef81f8 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:35.026623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31929fcf-5722-4f5a-9409-cbe6f1ef81f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:35.070740 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-31929fcf-5722-4f5a-9409-cbe6f1ef81f8 None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:35.072570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-31929fcf-5722-4f5a-9409-cbe6f1ef81f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:35.087721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1239/2469] 10.222.0.48 () {58 vars in 967 bytes} [Sat Sep 17 03:40:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:35.101735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aad26-b520-4731-9f1b-f2ec17bcae5a service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:35.119031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7aad26-b520-4731-9f1b-f2ec17bcae5a service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:35.131441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d983f-a0cb-4846-a75a-a6aa00ca8fb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:35.132067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d983f-a0cb-4846-a75a-a6aa00ca8fb8 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:35.132402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d983f-a0cb-4846-a75a-a6aa00ca8fb8 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:35.132678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d983f-a0cb-4846-a75a-a6aa00ca8fb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:35.156325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d983f-a0cb-4846-a75a-a6aa00ca8fb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:35.162566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d983f-a0cb-4846-a75a-a6aa00ca8fb8 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:35.174729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1231/2470] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:40:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:40:37.563471 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31929fcf-5722-4f5a-9409-cbe6f1ef81f8 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:37.565006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-31929fcf-5722-4f5a-9409-cbe6f1ef81f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:37.648551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31929fcf-5722-4f5a-9409-cbe6f1ef81f8 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:37.655513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:37.656160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:37.656436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:37.656695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] PATH_INFO: `/v3/users/229f9f65d3c947e6964bd7e0408b365c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:37.658518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229f9f65d3c947e6964bd7e0408b365c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:37.660650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:37.721027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229f9f65d3c947e6964bd7e0408b365c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:37.721960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229f9f65d3c947e6964bd7e0408b365c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:37.733288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229f9f65d3c947e6964bd7e0408b365c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:37.754247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229f9f65d3c947e6964bd7e0408b365c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:37.755629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229f9f65d3c947e6964bd7e0408b365c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:37.770074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1240/2471] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:40:37 2022] DELETE /identity/v3/users/229f9f65d3c947e6964bd7e0408b365c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:40:37.775459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e86cc7-763d-4112-9f4e-7365dcaf75c1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:37.776029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e86cc7-763d-4112-9f4e-7365dcaf75c1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:37.776137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e86cc7-763d-4112-9f4e-7365dcaf75c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:37.795547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c0e86cc7-763d-4112-9f4e-7365dcaf75c1 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:37.796755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c0e86cc7-763d-4112-9f4e-7365dcaf75c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:37.877002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1232/2472] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:40:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:37.892746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:37.894546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:37.955856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:40:37.961549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a4ad09-5f4d-4dd8-8605-8107874b2bf2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:37.967142 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:37.967795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:37.968113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:37.968555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:37.979838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:37.981535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:37.992236 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1241/2473] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:40:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:40:38.510731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e86cc7-763d-4112-9f4e-7365dcaf75c1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:38.512293 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c0e86cc7-763d-4112-9f4e-7365dcaf75c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:38.525018 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e86cc7-763d-4112-9f4e-7365dcaf75c1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:38.531441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:38.531760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:38.532135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:38.532491 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] PATH_INFO: `/v3/projects/34adcd1df6534cb9ba5c6a45c9fd662b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:38.533918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] RBAC: Authorizing `identity:delete_project(project_id=34adcd1df6534cb9ba5c6a45c9fd662b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:38.535983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:38.585153 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34adcd1df6534cb9ba5c6a45c9fd662b', 'request_id': 'req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:38.590858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34adcd1df6534cb9ba5c6a45c9fd662b', 'request_id': 'req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:38.597055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34adcd1df6534cb9ba5c6a45c9fd662b', 'request_id': 'req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:38.609981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] The token cache is being invalidate because project 34adcd1df6534cb9ba5c6a45c9fd662b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:40:38.610282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:38.610870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-634c45b0-dcd6-4ed0-bba5-1b2cf578106f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:40:38.612698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1233/2474] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:40:38 2022] DELETE /identity/v3/projects/34adcd1df6534cb9ba5c6a45c9fd662b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:40:47.988431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:40:48.606880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:40:49.939407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:49.941084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:49.953367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4db8e4-82bb-4f1b-bfb7-83558ca81a1a service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:50.003538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:50.004145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:50.004420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:50.004688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:50.006934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:50.068593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:50.070062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:50.079826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1242/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:40:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:40:52.044108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d6d9-30ba-42d3-bdee-ef2c70b167bb None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:52.045142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d6d9-30ba-42d3-bdee-ef2c70b167bb None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:52.045621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f769d6d9-30ba-42d3-bdee-ef2c70b167bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:52.075158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f769d6d9-30ba-42d3-bdee-ef2c70b167bb None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:52.077091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f769d6d9-30ba-42d3-bdee-ef2c70b167bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:52.199483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1234/2476] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:52.254799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:52.258424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:52.355027 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ee953-2a1b-4d38-b39a-cbf5bb571701 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:52.362641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff57f9-5c90-4795-a203-50c33b3a0aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:52.364185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff57f9-5c90-4795-a203-50c33b3a0aa3 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:52.364686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff57f9-5c90-4795-a203-50c33b3a0aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:52.365180 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff57f9-5c90-4795-a203-50c33b3a0aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:52.376449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff57f9-5c90-4795-a203-50c33b3a0aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:52.379784 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ff57f9-5c90-4795-a203-50c33b3a0aa3 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:52.392449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1243/2477] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:40:56.345310 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d015-750d-406e-826e-f8d7ba1b338f None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:56.345951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d015-750d-406e-826e-f8d7ba1b338f None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:56.345951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63d015-750d-406e-826e-f8d7ba1b338f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:56.366477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ae63d015-750d-406e-826e-f8d7ba1b338f None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:56.367685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ae63d015-750d-406e-826e-f8d7ba1b338f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:56.376664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1235/2478] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:56.417838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff57f9-5c90-4795-a203-50c33b3a0aa3 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:56.429658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff57f9-5c90-4795-a203-50c33b3a0aa3 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:56.436086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:56.436680 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:56.436980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:56.437245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:56.446109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:56.447694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:56.459173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1244/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:40:59.430440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9721ed-ae50-4337-9f1e-39b2a122b5ce None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:59.430997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9721ed-ae50-4337-9f1e-39b2a122b5ce None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:59.430997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9721ed-ae50-4337-9f1e-39b2a122b5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:59.455151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2d9721ed-ae50-4337-9f1e-39b2a122b5ce None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:40:59.456401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2d9721ed-ae50-4337-9f1e-39b2a122b5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:59.465101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1236/2480] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:40:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:40:59.492086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:40:59.493679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:40:59.509490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71a77ac-3a9f-423b-9117-b9f304a7097f service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:40:59.515611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb6d6-66f9-4c9d-b399-cb121fa4389c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:40:59.516250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb6d6-66f9-4c9d-b399-cb121fa4389c service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:40:59.516530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb6d6-66f9-4c9d-b399-cb121fa4389c service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:40:59.516801 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fb6d6-66f9-4c9d-b399-cb121fa4389c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:40:59.525776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fb6d6-66f9-4c9d-b399-cb121fa4389c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:40:59.527386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23fb6d6-66f9-4c9d-b399-cb121fa4389c service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:40:59.537239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1245/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:40:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:41:02.623177 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f38f9d-97f6-410c-884c-df4f208c2f84 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:02.623810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f38f9d-97f6-410c-884c-df4f208c2f84 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:02.623810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f38f9d-97f6-410c-884c-df4f208c2f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:02.645123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-03f38f9d-97f6-410c-884c-df4f208c2f84 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:41:02.646479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-03f38f9d-97f6-410c-884c-df4f208c2f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:41:02.655616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1237/2482] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:41:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:41:02.690168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb6d6-66f9-4c9d-b399-cb121fa4389c service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:41:02.702028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fb6d6-66f9-4c9d-b399-cb121fa4389c service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:41:02.709263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7329f-8eb5-47e3-bca0-1f4fa6043db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:41:02.709896 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7329f-8eb5-47e3-bca0-1f4fa6043db1 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:02.710176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7329f-8eb5-47e3-bca0-1f4fa6043db1 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:02.710439 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7329f-8eb5-47e3-bca0-1f4fa6043db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:02.716925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=100 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:41:02.719442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7329f-8eb5-47e3-bca0-1f4fa6043db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:41:02.721342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7329f-8eb5-47e3-bca0-1f4fa6043db1 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:41:02.731408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1246/2483] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:41:06.860878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640dce-3a3f-4062-93f0-8ed5500e947c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:06.861506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640dce-3a3f-4062-93f0-8ed5500e947c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:06.861506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640dce-3a3f-4062-93f0-8ed5500e947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:06.882740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5c640dce-3a3f-4062-93f0-8ed5500e947c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:41:06.883947 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5c640dce-3a3f-4062-93f0-8ed5500e947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:41:06.894735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1238/2484] 10.222.0.55 () {58 vars in 1016 bytes} [Sat Sep 17 03:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:41:06.921310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7329f-8eb5-47e3-bca0-1f4fa6043db1 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:41:06.933235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7329f-8eb5-47e3-bca0-1f4fa6043db1 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:41:06.940853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cd277b-6ac2-4dce-986b-fa0f4151c3bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:41:06.941387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd277b-6ac2-4dce-986b-fa0f4151c3bc service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:06.941661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd277b-6ac2-4dce-986b-fa0f4151c3bc service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:06.941956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cd277b-6ac2-4dce-986b-fa0f4151c3bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:06.950758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd277b-6ac2-4dce-986b-fa0f4151c3bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:41:06.952364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cd277b-6ac2-4dce-986b-fa0f4151c3bc service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:41:06.962066 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1247/2485] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:41:16.877397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=39 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:41:16.957811 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=8 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:41:37.168217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c648-0d33-4144-b188-313f81907dde None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:37.168732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c648-0d33-4144-b188-313f81907dde None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:37.168732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89c648-0d33-4144-b188-313f81907dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:37.188763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cf89c648-0d33-4144-b188-313f81907dde None None] MFA Rules not processed for user `f2f6fd1b96d44bde897fa70cfd5459f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:41:37.190026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf89c648-0d33-4144-b188-313f81907dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:41:37.254069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1239/2486] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:41:37.983347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e5e8-be61-4251-9a1d-445263bb6a66 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:37.984298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e5e8-be61-4251-9a1d-445263bb6a66 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:37.984580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2e5e8-be61-4251-9a1d-445263bb6a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:38.005472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3ef2e5e8-be61-4251-9a1d-445263bb6a66 None None] MFA Rules not processed for user `0da06a80220449fbad259cf76a8e0561`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:41:38.007602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3ef2e5e8-be61-4251-9a1d-445263bb6a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:41:38.075597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1248/2487] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:41:39.090437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89c648-0d33-4144-b188-313f81907dde None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:41:39.091909 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cf89c648-0d33-4144-b188-313f81907dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:41:39.115533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89c648-0d33-4144-b188-313f81907dde None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:41:39.124861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:41:39.125810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:39.126382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:39.126809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] PATH_INFO: `/v3/users/b54c8bd4b1b748a69f8b942c34ab9abe` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:39.128383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b54c8bd4b1b748a69f8b942c34ab9abe)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:41:39.131401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:41:39.197672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b54c8bd4b1b748a69f8b942c34ab9abe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.198657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b54c8bd4b1b748a69f8b942c34ab9abe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.209110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b54c8bd4b1b748a69f8b942c34ab9abe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.221851 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b54c8bd4b1b748a69f8b942c34ab9abe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.222995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ad299c23-0fc6-42e9-b537-98257ccc9fd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b54c8bd4b1b748a69f8b942c34ab9abe'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.247884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1240/2488] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:41:39 2022] DELETE /identity/v3/users/b54c8bd4b1b748a69f8b942c34ab9abe => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:41:39.428020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2e5e8-be61-4251-9a1d-445263bb6a66 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:41:39.439739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2e5e8-be61-4251-9a1d-445263bb6a66 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:41:39.497551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:41:39.498225 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:39.498504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:39.498775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] PATH_INFO: `/v3/projects/d0ef36ddc25f4ddc88b887a78849c9be` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:39.499883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ef36ddc25f4ddc88b887a78849c9be)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:41:39.502381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:41:39.554156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ef36ddc25f4ddc88b887a78849c9be', 'request_id': 'req-0116c380-92ac-4d67-b297-ffda6e884655'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.560984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ef36ddc25f4ddc88b887a78849c9be', 'request_id': 'req-0116c380-92ac-4d67-b297-ffda6e884655'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.568640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ef36ddc25f4ddc88b887a78849c9be', 'request_id': 'req-0116c380-92ac-4d67-b297-ffda6e884655'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.579987 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] The token cache is being invalidate because project d0ef36ddc25f4ddc88b887a78849c9be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:41:39.580418 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.581182 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:41:39.583064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1249/2489] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:41:39 2022] DELETE /identity/v3/projects/d0ef36ddc25f4ddc88b887a78849c9be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:41:49.240689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:41:49.576876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:41:58.172270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb592e-088f-4496-a650-02783a35fb2d None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:41:58.172834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb592e-088f-4496-a650-02783a35fb2d None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:41:58.172945 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb592e-088f-4496-a650-02783a35fb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:41:58.201535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6dcb592e-088f-4496-a650-02783a35fb2d None None] MFA Rules not processed for user `2dbc066c60a747cf99de32f5678c284f`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:41:58.202804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6dcb592e-088f-4496-a650-02783a35fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:41:58.268029 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1241/2490] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:41:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:42:07.553501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:07.555650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:07.632082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116c380-92ac-4d67-b297-ffda6e884655 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:07.636658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1913cef-2e68-40b1-ba46-ed2f2aaf199f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:07.637245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913cef-2e68-40b1-ba46-ed2f2aaf199f service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:07.637523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913cef-2e68-40b1-ba46-ed2f2aaf199f service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:07.637797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1913cef-2e68-40b1-ba46-ed2f2aaf199f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:07.639702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f1913cef-2e68-40b1-ba46-ed2f2aaf199f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:07.723958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1913cef-2e68-40b1-ba46-ed2f2aaf199f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:07.726115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1913cef-2e68-40b1-ba46-ed2f2aaf199f service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:07.738972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1250/2491] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:42:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:42:08.259790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=25 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:42:08.920308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb592e-088f-4496-a650-02783a35fb2d None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:08.921986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6dcb592e-088f-4496-a650-02783a35fb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:08.935088 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb592e-088f-4496-a650-02783a35fb2d None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:08.938820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090c6af-2368-40a1-b00a-99536e32c452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:08.939417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090c6af-2368-40a1-b00a-99536e32c452 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:08.939685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090c6af-2368-40a1-b00a-99536e32c452 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:08.939950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090c6af-2368-40a1-b00a-99536e32c452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:08.941616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2090c6af-2368-40a1-b00a-99536e32c452 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:08.954560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090c6af-2368-40a1-b00a-99536e32c452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:08.956007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090c6af-2368-40a1-b00a-99536e32c452 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:08.967327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1242/2492] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:42:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:42:11.710342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe102-7084-41d2-9b0a-af5f75e86d99 None None] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:11.710967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe102-7084-41d2-9b0a-af5f75e86d99 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:11.710967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983fe102-7084-41d2-9b0a-af5f75e86d99 None None] PATH_INFO: `/` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:11.712463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1251/2493] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 03:42:11.718926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90611-7f05-4ba2-87a4-e4e0e9fa8996 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:11.719407 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90611-7f05-4ba2-87a4-e4e0e9fa8996 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:11.719624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd90611-7f05-4ba2-87a4-e4e0e9fa8996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:11.740069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1bd90611-7f05-4ba2-87a4-e4e0e9fa8996 None None] MFA Rules not processed for user `18061b868be44122a849e2e239b56f60`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:42:11.741385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1bd90611-7f05-4ba2-87a4-e4e0e9fa8996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:11.748802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1243/2494] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:42:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:42:11.761998 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe102-7084-41d2-9b0a-af5f75e86d99 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:11.774114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983fe102-7084-41d2-9b0a-af5f75e86d99 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:11.777953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:11.778549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:11.778818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:11.779081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:11.786979 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:11.788414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:11.797943 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1252/2495] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:42:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:42:21.734788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=9 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:42:21.793958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=60 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:42:36.332578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90611-7f05-4ba2-87a4-e4e0e9fa8996 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:36.335419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1bd90611-7f05-4ba2-87a4-e4e0e9fa8996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:36.356690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd90611-7f05-4ba2-87a4-e4e0e9fa8996 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:36.362848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:36.363475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:36.363749 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:36.364020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:36.365882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:36.432795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:36.435155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:36.446162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1244/2496] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:42:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:42:38.821102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:38.823021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:38.842619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2050c3f-3b45-432a-9707-11b336f7fc51 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:38.849496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:38.850147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:38.850431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:38.850703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:38.852610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:38.913054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:38.914702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:38.931414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1253/2497] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:42:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:42:39.870950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:39.897681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9ba147-bbfd-41c8-b997-0a95b67360a2 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:39.915198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2e4ab7-8f89-44b2-a225-a2900b00fc7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:39.915973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e4ab7-8f89-44b2-a225-a2900b00fc7d service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:39.916263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e4ab7-8f89-44b2-a225-a2900b00fc7d service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:39.916535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2e4ab7-8f89-44b2-a225-a2900b00fc7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:39.918341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6a2e4ab7-8f89-44b2-a225-a2900b00fc7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:39.947330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e4ab7-8f89-44b2-a225-a2900b00fc7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:39.948998 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2e4ab7-8f89-44b2-a225-a2900b00fc7d service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:39.960685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1245/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:42:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:42:40.094508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:40.104845 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b2664-67a3-419b-b468-992c184aacb9 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:40.108536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:40.109435 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:40.109719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:40.110723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:40.113013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:40.123449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:40.124961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:40.134032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1254/2499] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:42:40 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:42:49.226717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71773d-5a2b-4c5f-8b70-535bc393c1bc None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:49.227230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71773d-5a2b-4c5f-8b70-535bc393c1bc None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:49.227367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71773d-5a2b-4c5f-8b70-535bc393c1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:49.247009 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ab71773d-5a2b-4c5f-8b70-535bc393c1bc None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:42:49.248254 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ab71773d-5a2b-4c5f-8b70-535bc393c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:49.302251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1246/2500] 10.222.0.48 () {58 vars in 967 bytes} [Sat Sep 17 03:42:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:42:49.354242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:49.355856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:49.428955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351c3b-2207-49b4-bbda-6205415b2eea service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:49.435075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:49.435676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:49.435947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:49.436214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:49.444570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:49.446213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:49.454336 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1255/2501] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:42:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:42:57.217584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71773d-5a2b-4c5f-8b70-535bc393c1bc None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:57.219049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ab71773d-5a2b-4c5f-8b70-535bc393c1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:57.298475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:57.299947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:57.316332 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71773d-5a2b-4c5f-8b70-535bc393c1bc None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:57.323756 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:57.324658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:57.325130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:57.325399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:57.327180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:57.339626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:57.341219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:57.351466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1247/2502] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:42:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:42:57.375981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20e35f-0442-42fe-93b3-768fb45537f4 service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:57.381960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:57.382702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:57.383174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:57.384044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] PATH_INFO: `/v3/users/003520607376412ea5e0fd7faab392d1` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:57.385981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] RBAC: Authorizing `identity:delete_user(user_id=003520607376412ea5e0fd7faab392d1)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:57.388043 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:57.405163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:42:57.435694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003520607376412ea5e0fd7faab392d1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.436328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003520607376412ea5e0fd7faab392d1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.444744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003520607376412ea5e0fd7faab392d1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.456926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003520607376412ea5e0fd7faab392d1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.457570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003520607376412ea5e0fd7faab392d1'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.470105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1256/2503] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:42:57 2022] DELETE /identity/v3/users/003520607376412ea5e0fd7faab392d1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:42:57.644450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:57.656804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a0fd0-7576-45f7-98f4-cc502f6ade5b service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:57.678820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:42:57.723467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:57.724220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:57.724559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:57.724897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] PATH_INFO: `/v3/projects/beef0d51792b46b586acd4b152b7fc9f` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:57.726280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beef0d51792b46b586acd4b152b7fc9f)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:57.728285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:57.778118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beef0d51792b46b586acd4b152b7fc9f', 'request_id': 'req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.783770 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beef0d51792b46b586acd4b152b7fc9f', 'request_id': 'req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.790383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beef0d51792b46b586acd4b152b7fc9f', 'request_id': 'req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.805622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] The token cache is being invalidate because project beef0d51792b46b586acd4b152b7fc9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:42:57.806037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.806672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.808144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1248/2504] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:42:57 2022] DELETE /identity/v3/projects/beef0d51792b46b586acd4b152b7fc9f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:42:57.812379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:57.813831 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:57.827337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5b46e-3754-42af-b6be-057af9e7301b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:57.886585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:57.887519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:57.887862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:57.888048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] PATH_INFO: `/v3/users/ab0cb994c5ee4df894680b0475917809` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:57.889162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab0cb994c5ee4df894680b0475917809)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:57.891119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:57.944092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab0cb994c5ee4df894680b0475917809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.944822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab0cb994c5ee4df894680b0475917809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.953580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab0cb994c5ee4df894680b0475917809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.966208 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab0cb994c5ee4df894680b0475917809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.966836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-3bc0e4f8-0359-4831-ba8d-27e67cbdeeb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab0cb994c5ee4df894680b0475917809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:57.983362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1257/2505] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:42:57 2022] DELETE /identity/v3/users/ab0cb994c5ee4df894680b0475917809 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:42:58.186936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:42:58.188505 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:42:58.203822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e2b5d-8ca4-4ca6-a7db-03785eb53a10 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:42:58.274108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:42:58.274748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:42:58.275225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:42:58.275494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] PATH_INFO: `/v3/projects/773571224d2942b9adebe4f3594acc87` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:42:58.276676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773571224d2942b9adebe4f3594acc87)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:42:58.279403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:42:58.370311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773571224d2942b9adebe4f3594acc87', 'request_id': 'req-0c451e65-48a1-4c21-993a-9e63f6ed06a2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:58.372262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:42:58.377091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773571224d2942b9adebe4f3594acc87', 'request_id': 'req-0c451e65-48a1-4c21-993a-9e63f6ed06a2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:58.387005 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773571224d2942b9adebe4f3594acc87', 'request_id': 'req-0c451e65-48a1-4c21-993a-9e63f6ed06a2'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:58.404778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] The token cache is being invalidate because project 773571224d2942b9adebe4f3594acc87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:42:58.405068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:58.405690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:42:58.407230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1249/2506] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:42:58 2022] DELETE /identity/v3/projects/773571224d2942b9adebe4f3594acc87 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:02.238603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed579f-401f-46a2-8a16-55efe7aefcf6 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:02.239078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed579f-401f-46a2-8a16-55efe7aefcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:02.239191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed579f-401f-46a2-8a16-55efe7aefcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:02.259929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9aed579f-401f-46a2-8a16-55efe7aefcf6 None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:02.261192 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9aed579f-401f-46a2-8a16-55efe7aefcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:02.269713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:02.318723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1258/2507] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:43:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:02.331844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:02.333434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:02.413662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c451e65-48a1-4c21-993a-9e63f6ed06a2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:02.419680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:02.420296 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:02.420570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:02.420837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:02.430849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:02.432466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:02.441630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1250/2508] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:43:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:43:02.958816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed579f-401f-46a2-8a16-55efe7aefcf6 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:02.960321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9aed579f-401f-46a2-8a16-55efe7aefcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:03.067911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed579f-401f-46a2-8a16-55efe7aefcf6 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:03.075495 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:03.076115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:03.076429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:03.076657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:03.078447 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:03.092655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:03.095708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:03.107239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1259/2509] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:05.215121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:05.217154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:05.302606 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16608e16-8e01-46f8-86e1-fe8c2faaced5 service swift] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:05.308358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:05.309085 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:05.309370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:05.309869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:05.312725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:05.388129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:05.389744 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:05.401066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1251/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:10.307221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:10.309598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:10.327735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf080a-22bb-46a8-a64b-cce79c961f0b service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:10.332409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:10.333141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:10.333486 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:10.333905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] PATH_INFO: `/v3/users/0da06a80220449fbad259cf76a8e0561` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:10.335270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da06a80220449fbad259cf76a8e0561)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:10.337392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:10.395083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da06a80220449fbad259cf76a8e0561'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.395798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da06a80220449fbad259cf76a8e0561'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.405738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da06a80220449fbad259cf76a8e0561'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.421123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da06a80220449fbad259cf76a8e0561'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.421951 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-90750193-7c05-4ec2-9b80-ac525727a134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da06a80220449fbad259cf76a8e0561'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.437194 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1260/2511] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:43:10 2022] DELETE /identity/v3/users/0da06a80220449fbad259cf76a8e0561 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:10.664016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:10.697481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d81ab-2f4f-49f4-80b0-c21c6de6def7 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:10.733800 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:10.812212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:10.812886 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:10.813172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:10.813445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] PATH_INFO: `/v3/projects/85552d7a5517459ebf4c55260bacd5c0` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:10.815370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85552d7a5517459ebf4c55260bacd5c0)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:10.817331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:10.942973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85552d7a5517459ebf4c55260bacd5c0', 'request_id': 'req-b4553137-76ee-43d1-a652-eed29769c446'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.954458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85552d7a5517459ebf4c55260bacd5c0', 'request_id': 'req-b4553137-76ee-43d1-a652-eed29769c446'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.961777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85552d7a5517459ebf4c55260bacd5c0', 'request_id': 'req-b4553137-76ee-43d1-a652-eed29769c446'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.977458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] The token cache is being invalidate because project 85552d7a5517459ebf4c55260bacd5c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:43:10.977818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.978463 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-b4553137-76ee-43d1-a652-eed29769c446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:10.980304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1252/2512] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:43:10 2022] DELETE /identity/v3/projects/85552d7a5517459ebf4c55260bacd5c0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:10.989580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617fc4-c363-47fb-9668-d9a5f3f0e2dd None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:10.989580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617fc4-c363-47fb-9668-d9a5f3f0e2dd None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:10.989580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4617fc4-c363-47fb-9668-d9a5f3f0e2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.010419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d4617fc4-c363-47fb-9668-d9a5f3f0e2dd None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:11.011738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d4617fc4-c363-47fb-9668-d9a5f3f0e2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:11.023112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:11.103044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1261/2513] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:11.110768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324137-80b7-49f3-9c13-3c88b90ede6b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.111051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324137-80b7-49f3-9c13-3c88b90ede6b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.111325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09324137-80b7-49f3-9c13-3c88b90ede6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.139206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-09324137-80b7-49f3-9c13-3c88b90ede6b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:11.140430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-09324137-80b7-49f3-9c13-3c88b90ede6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:11.151309 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1253/2514] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:11.155424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617fc4-c363-47fb-9668-d9a5f3f0e2dd None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:11.169507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4617fc4-c363-47fb-9668-d9a5f3f0e2dd None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:11.174355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:11.174969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.175250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.175523 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.176184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:43:11.176608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:11.178267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:11.193866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1262/2515] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:43:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:43:11.197123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09324137-80b7-49f3-9c13-3c88b90ede6b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:11.208456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09324137-80b7-49f3-9c13-3c88b90ede6b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:11.213385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a25cf-96d9-4fc7-9356-07cc045464a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:11.214064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a25cf-96d9-4fc7-9356-07cc045464a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.214345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a25cf-96d9-4fc7-9356-07cc045464a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.214625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a25cf-96d9-4fc7-9356-07cc045464a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.215272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a25cf-96d9-4fc7-9356-07cc045464a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:11.217214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a25cf-96d9-4fc7-9356-07cc045464a3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:11.249469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1254/2516] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:43:11 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:11.253860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:11.266655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aab02e-37c2-4f05-b091-c9700568e72c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:11.335567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308e806-b712-4fe1-a0b0-96515a74b862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:11.337113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e806-b712-4fe1-a0b0-96515a74b862 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.337978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e806-b712-4fe1-a0b0-96515a74b862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.338702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b308e806-b712-4fe1-a0b0-96515a74b862 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.340155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308e806-b712-4fe1-a0b0-96515a74b862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:11.343809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b308e806-b712-4fe1-a0b0-96515a74b862 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:11.371342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1263/2517] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:43:11 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:43:11.376556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a25cf-96d9-4fc7-9356-07cc045464a3 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:11.387502 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a25cf-96d9-4fc7-9356-07cc045464a3 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:11.392093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fc0e5-b591-4157-b2c1-b854232940ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:11.392702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc0e5-b591-4157-b2c1-b854232940ed admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.392976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc0e5-b591-4157-b2c1-b854232940ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.393244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097fc0e5-b591-4157-b2c1-b854232940ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.393934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fc0e5-b591-4157-b2c1-b854232940ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:11.395546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097fc0e5-b591-4157-b2c1-b854232940ed admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:11.409351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1255/2518] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:11.410935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308e806-b712-4fe1-a0b0-96515a74b862 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:11.424587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b308e806-b712-4fe1-a0b0-96515a74b862 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:11.429743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0b1e1-4c7b-4100-91e3-c8e7526598d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:11.430400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0b1e1-4c7b-4100-91e3-c8e7526598d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.430681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0b1e1-4c7b-4100-91e3-c8e7526598d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.431013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0b1e1-4c7b-4100-91e3-c8e7526598d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.431692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0b1e1-4c7b-4100-91e3-c8e7526598d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:11.433391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0b1e1-4c7b-4100-91e3-c8e7526598d8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:11.448715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1264/2519] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:11.449435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fc0e5-b591-4157-b2c1-b854232940ed admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:11.460442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097fc0e5-b591-4157-b2c1-b854232940ed admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:11.465548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:11.466268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.466548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.466822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] PATH_INFO: `/v3/projects/41e6e18961a7409a8014d832de70d299/users/8f119e7a0b66415ab88cd641886c2e82/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.482496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e6e18961a7409a8014d832de70d299, user_id=8f119e7a0b66415ab88cd641886c2e82, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:11.485280 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:11.502089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1256/2520] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:43:11 2022] PUT /identity/v3/projects/41e6e18961a7409a8014d832de70d299/users/8f119e7a0b66415ab88cd641886c2e82/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:43:11.509508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb9e5-adf9-422a-b1b5-a2508ee7b692 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.509508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb9e5-adf9-422a-b1b5-a2508ee7b692 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.509508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ddb9e5-adf9-422a-b1b5-a2508ee7b692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.532134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a7ddb9e5-adf9-422a-b1b5-a2508ee7b692 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:11.533485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a7ddb9e5-adf9-422a-b1b5-a2508ee7b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:11.613885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1265/2521] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:11.624073 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:11.625911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:11.693007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:11.699620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc2ff3-d0e5-4296-8365-13792b9aa19f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:11.710747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec88022-5e51-4009-a273-2397db9f79cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:11.711807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88022-5e51-4009-a273-2397db9f79cb service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:11.712600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88022-5e51-4009-a273-2397db9f79cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:11.712724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec88022-5e51-4009-a273-2397db9f79cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:11.725011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec88022-5e51-4009-a273-2397db9f79cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:11.726579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec88022-5e51-4009-a273-2397db9f79cb service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:11.737823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1257/2522] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:14.825591 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb9e5-adf9-422a-b1b5-a2508ee7b692 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:14.828664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a7ddb9e5-adf9-422a-b1b5-a2508ee7b692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:14.852076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ddb9e5-adf9-422a-b1b5-a2508ee7b692 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:14.856078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:14.856879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:14.857244 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:14.857600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:14.859661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:14.873668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:14.875315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:14.889326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1266/2523] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:17.569126 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881ccaa-fe03-4ac5-9016-5c811ddd1ab3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:17.569640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881ccaa-fe03-4ac5-9016-5c811ddd1ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:17.569721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8881ccaa-fe03-4ac5-9016-5c811ddd1ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:17.611714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8881ccaa-fe03-4ac5-9016-5c811ddd1ab3 None None] MFA Rules not processed for user `8f119e7a0b66415ab88cd641886c2e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:17.613303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8881ccaa-fe03-4ac5-9016-5c811ddd1ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:17.695786 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1258/2524] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:17.711270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:17.713855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:17.730248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:17.838077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a7aca-eff8-46e7-b128-449940045d6b service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:17.844465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:17.845257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:17.845540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:17.845849 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:17.856807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:17.858547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:17.882245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1267/2525] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:19.044469 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881ccaa-fe03-4ac5-9016-5c811ddd1ab3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:19.052139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8881ccaa-fe03-4ac5-9016-5c811ddd1ab3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:19.057859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206d2314-bc36-4447-ae44-d13474be6615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:19.058935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d2314-bc36-4447-ae44-d13474be6615 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:19.059311 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d2314-bc36-4447-ae44-d13474be6615 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:19.059678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206d2314-bc36-4447-ae44-d13474be6615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:19.062229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-206d2314-bc36-4447-ae44-d13474be6615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:19.079612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d2314-bc36-4447-ae44-d13474be6615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:19.081285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206d2314-bc36-4447-ae44-d13474be6615 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:19.100919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1259/2526] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:19.423778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:19.425355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:19.440550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea2ba3-3bc3-4427-9dc4-6104e062f374 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:19.448906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:19.449791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:19.450245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:19.450562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] PATH_INFO: `/v3/users/2dbc066c60a747cf99de32f5678c284f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:19.451793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dbc066c60a747cf99de32f5678c284f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:19.453894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:19.517887 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dbc066c60a747cf99de32f5678c284f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:19.518563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dbc066c60a747cf99de32f5678c284f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:19.530814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dbc066c60a747cf99de32f5678c284f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:19.553540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dbc066c60a747cf99de32f5678c284f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:19.554346 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dbc066c60a747cf99de32f5678c284f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:19.564847 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3417-7a39-4de0-9a43-38b09da67b86 None None] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:19.565643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3417-7a39-4de0-9a43-38b09da67b86 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:19.565938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce3417-7a39-4de0-9a43-38b09da67b86 None None] PATH_INFO: `/` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:19.568017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1260/2527] 10.222.0.48 () {54 vars in 921 bytes} [Sat Sep 17 03:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 03:43:19.575608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c95e-8c37-4f00-8005-b29be14535a8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:19.576119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c95e-8c37-4f00-8005-b29be14535a8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:19.577144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1c95e-8c37-4f00-8005-b29be14535a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:19.578600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1268/2528] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:43:19 2022] DELETE /identity/v3/users/2dbc066c60a747cf99de32f5678c284f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:19.601880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cfa1c95e-8c37-4f00-8005-b29be14535a8 None None] MFA Rules not processed for user `fda0f612b2ec42b2beac9af0b49ccff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:19.603244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cfa1c95e-8c37-4f00-8005-b29be14535a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:19.703630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1261/2529] 10.222.0.48 () {58 vars in 1018 bytes} [Sat Sep 17 03:43:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:43:19.717403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:19.719902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:19.799662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1c95e-8c37-4f00-8005-b29be14535a8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:19.801121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cfa1c95e-8c37-4f00-8005-b29be14535a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:19.828294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5338d0-999a-48c0-8d18-49ef0e8983ec admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:19.846573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:19.847622 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:19.848126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:19.849202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:19.873829 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:19.876213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:19.893877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1269/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:19.916854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:19.921995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1c95e-8c37-4f00-8005-b29be14535a8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:19.928235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:19.929423 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:19.929982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:19.930445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] PATH_INFO: `/v3/projects/379e8c4381df423a92e7c6b05105a1c3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:19.931607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] RBAC: Authorizing `identity:delete_project(project_id=379e8c4381df423a92e7c6b05105a1c3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:19.933718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:20.000209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379e8c4381df423a92e7c6b05105a1c3', 'request_id': 'req-4aad9212-0a47-45b7-af36-65ebf4cb4889'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:20.005381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:20.006629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379e8c4381df423a92e7c6b05105a1c3', 'request_id': 'req-4aad9212-0a47-45b7-af36-65ebf4cb4889'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:20.010931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:20.015454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379e8c4381df423a92e7c6b05105a1c3', 'request_id': 'req-4aad9212-0a47-45b7-af36-65ebf4cb4889'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:20.033687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] The token cache is being invalidate because project 379e8c4381df423a92e7c6b05105a1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:43:20.034008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:20.034765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4aad9212-0a47-45b7-af36-65ebf4cb4889 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:20.039892 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1262/2531] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:43:19 2022] DELETE /identity/v3/projects/379e8c4381df423a92e7c6b05105a1c3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:20.042323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2ec8-4477-4485-b690-82021e2726a3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.042741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2ec8-4477-4485-b690-82021e2726a3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.043175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a2ec8-4477-4485-b690-82021e2726a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.050378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:20.072781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-041a2ec8-4477-4485-b690-82021e2726a3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:20.074255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-041a2ec8-4477-4485-b690-82021e2726a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:20.155293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce11a0-a5c0-457d-8bb1-e7e64c675298 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:20.174197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1263/2532] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:20.178442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956031b-1624-4d0b-9f3c-48a834553aad None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.178859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956031b-1624-4d0b-9f3c-48a834553aad None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.179135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956031b-1624-4d0b-9f3c-48a834553aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.210189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e956031b-1624-4d0b-9f3c-48a834553aad None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:20.211766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e956031b-1624-4d0b-9f3c-48a834553aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:20.226708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1264/2533] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:20.231132 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956031b-1624-4d0b-9f3c-48a834553aad None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:20.250481 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956031b-1624-4d0b-9f3c-48a834553aad None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:20.257618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:20.261925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:20.262551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.263041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.263331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.265176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:20.265944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.267985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.268546 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.269360 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:43:20.271285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:20.273124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:20.278498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:20.280481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:20.294911 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1265/2534] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:43:20.298797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1270/2535] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:20.300086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:20.310982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1d9d99-1c9f-4b3a-a17d-efe8aafe5928 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:20.316494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adc341-9fcd-471b-bb57-cb6004907cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:20.317393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adc341-9fcd-471b-bb57-cb6004907cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.318033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adc341-9fcd-471b-bb57-cb6004907cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.318755 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adc341-9fcd-471b-bb57-cb6004907cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.320303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adc341-9fcd-471b-bb57-cb6004907cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:20.322968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adc341-9fcd-471b-bb57-cb6004907cf7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:20.388321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1266/2536] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:43:20 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:20.392670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:20.407051 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3937f34-faf2-481e-ae46-14a40a42ca20 service placement] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:20.487317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19cb02a-9d25-4210-9803-1885996f023a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:20.488173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cb02a-9d25-4210-9803-1885996f023a admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.488459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cb02a-9d25-4210-9803-1885996f023a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.490193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19cb02a-9d25-4210-9803-1885996f023a admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.490879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cb02a-9d25-4210-9803-1885996f023a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:20.493339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19cb02a-9d25-4210-9803-1885996f023a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:20.524211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1271/2537] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:43:20 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:43:20.525960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adc341-9fcd-471b-bb57-cb6004907cf7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:20.541286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adc341-9fcd-471b-bb57-cb6004907cf7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:20.549122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283aa65-181b-4090-934e-2900dddc30b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:20.550210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283aa65-181b-4090-934e-2900dddc30b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.550813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283aa65-181b-4090-934e-2900dddc30b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.551270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283aa65-181b-4090-934e-2900dddc30b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.552091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283aa65-181b-4090-934e-2900dddc30b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:20.554078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f283aa65-181b-4090-934e-2900dddc30b2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:20.560720 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbef9-5142-4244-926e-1bd50d264830 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.561011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbef9-5142-4244-926e-1bd50d264830 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.561292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dbef9-5142-4244-926e-1bd50d264830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.571448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1267/2538] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:20.572574 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283aa65-181b-4090-934e-2900dddc30b2 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:20.584621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-7e5dbef9-5142-4244-926e-1bd50d264830 None None] MFA Rules not processed for user `8f119e7a0b66415ab88cd641886c2e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:20.586069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283aa65-181b-4090-934e-2900dddc30b2 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:20.586302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7e5dbef9-5142-4244-926e-1bd50d264830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:20.598592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e989-5fc6-4137-8b67-ba63716ef3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:20.599240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e989-5fc6-4137-8b67-ba63716ef3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.599648 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e989-5fc6-4137-8b67-ba63716ef3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.600107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e989-5fc6-4137-8b67-ba63716ef3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.600812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e989-5fc6-4137-8b67-ba63716ef3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:20.602476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748e989-5fc6-4137-8b67-ba63716ef3b5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:20.626904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1268/2539] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:20.629247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e989-5fc6-4137-8b67-ba63716ef3b5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:20.640535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:20.647837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748e989-5fc6-4137-8b67-ba63716ef3b5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:20.654587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9953eb3-8f97-4b11-8928-22504f88e56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:20.655619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953eb3-8f97-4b11-8928-22504f88e56f admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.656096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953eb3-8f97-4b11-8928-22504f88e56f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.656540 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9953eb3-8f97-4b11-8928-22504f88e56f admin admin] PATH_INFO: `/v3/projects/4fc0e843dfa8486ab638a34dd4463d3e/users/601248ea72634bd4aeda0db24577b844/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.676761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9953eb3-8f97-4b11-8928-22504f88e56f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fc0e843dfa8486ab638a34dd4463d3e, user_id=601248ea72634bd4aeda0db24577b844, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:20.681353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9953eb3-8f97-4b11-8928-22504f88e56f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:20.707382 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:20.714768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1269/2540] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:43:20 2022] PUT /identity/v3/projects/4fc0e843dfa8486ab638a34dd4463d3e/users/601248ea72634bd4aeda0db24577b844/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:20.725612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b55d3-29fd-4244-96b0-03f02792bfdf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:20.726622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b55d3-29fd-4244-96b0-03f02792bfdf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:20.727622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b55d3-29fd-4244-96b0-03f02792bfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:20.754349 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1272/2541] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:20.786618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-541b55d3-29fd-4244-96b0-03f02792bfdf None None] MFA Rules not processed for user `601248ea72634bd4aeda0db24577b844`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:20.788223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-541b55d3-29fd-4244-96b0-03f02792bfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:20.891697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1270/2542] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:43:20.896945 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dbef9-5142-4244-926e-1bd50d264830 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:20.916663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dbef9-5142-4244-926e-1bd50d264830 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.007343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d957-9b42-4071-b812-d81b592f970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.007974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d957-9b42-4071-b812-d81b592f970e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.008253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d957-9b42-4071-b812-d81b592f970e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.008519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718d957-9b42-4071-b812-d81b592f970e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.010098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d957-9b42-4071-b812-d81b592f970e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.011785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718d957-9b42-4071-b812-d81b592f970e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.045817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1273/2543] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:43:20 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:21.049269 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b55d3-29fd-4244-96b0-03f02792bfdf None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:21.061317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b55d3-29fd-4244-96b0-03f02792bfdf None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.126879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a1761-b81f-4ecc-8907-239d9fc17c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.127508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a1761-b81f-4ecc-8907-239d9fc17c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.127787 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a1761-b81f-4ecc-8907-239d9fc17c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.128078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a1761-b81f-4ecc-8907-239d9fc17c25 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.129036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a1761-b81f-4ecc-8907-239d9fc17c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.131235 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a1761-b81f-4ecc-8907-239d9fc17c25 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.168383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1271/2544] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:43:21 2022] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:21.171995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d957-9b42-4071-b812-d81b592f970e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:21.188326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718d957-9b42-4071-b812-d81b592f970e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.196146 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80a29-b3d2-4784-bda4-692bf0a2c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.196928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80a29-b3d2-4784-bda4-692bf0a2c284 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.197415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80a29-b3d2-4784-bda4-692bf0a2c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.197906 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff80a29-b3d2-4784-bda4-692bf0a2c284 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.199370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff80a29-b3d2-4784-bda4-692bf0a2c284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.201203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff80a29-b3d2-4784-bda4-692bf0a2c284 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.219164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1274/2545] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:43:21.220238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a1761-b81f-4ecc-8907-239d9fc17c25 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:21.232200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a1761-b81f-4ecc-8907-239d9fc17c25 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.237251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.237982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.238260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.238530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] PATH_INFO: `/v3/projects/60d5dd97db9d49cf96a19944a2c9bcc1/users/b49632077a2540f094e67cda88976f58/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.266157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d5dd97db9d49cf96a19944a2c9bcc1, user_id=b49632077a2540f094e67cda88976f58, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.270465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.291602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1272/2546] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:43:21 2022] PUT /identity/v3/projects/60d5dd97db9d49cf96a19944a2c9bcc1/users/b49632077a2540f094e67cda88976f58/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:43:21.296050 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80a29-b3d2-4784-bda4-692bf0a2c284 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:21.313775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff80a29-b3d2-4784-bda4-692bf0a2c284 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.385100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:21.387139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37b0ae-f20c-4140-ad21-8e160b93cf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.387139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37b0ae-f20c-4140-ad21-8e160b93cf21 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.387522 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:21.387645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37b0ae-f20c-4140-ad21-8e160b93cf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.388059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37b0ae-f20c-4140-ad21-8e160b93cf21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.388679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37b0ae-f20c-4140-ad21-8e160b93cf21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.390389 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f37b0ae-f20c-4140-ad21-8e160b93cf21 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.404101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1275/2547] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:21.407604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37b0ae-f20c-4140-ad21-8e160b93cf21 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:21.419773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37b0ae-f20c-4140-ad21-8e160b93cf21 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.425340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e31c6e-d5e6-4612-bb1c-1f6b3b866a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.426563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31c6e-d5e6-4612-bb1c-1f6b3b866a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.426563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31c6e-d5e6-4612-bb1c-1f6b3b866a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.426905 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e31c6e-d5e6-4612-bb1c-1f6b3b866a08 admin admin] PATH_INFO: `/v3/projects/60d5dd97db9d49cf96a19944a2c9bcc1/users/b49632077a2540f094e67cda88976f58/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.429271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e31c6e-d5e6-4612-bb1c-1f6b3b866a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d5dd97db9d49cf96a19944a2c9bcc1, user_id=b49632077a2540f094e67cda88976f58, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.432045 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e31c6e-d5e6-4612-bb1c-1f6b3b866a08 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.443467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1276/2548] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:43:21 2022] PUT /identity/v3/projects/60d5dd97db9d49cf96a19944a2c9bcc1/users/b49632077a2540f094e67cda88976f58/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:21.454055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66c84-7d06-43ea-9dcb-f79058ea2950 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.454466 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66c84-7d06-43ea-9dcb-f79058ea2950 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.454836 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f66c84-7d06-43ea-9dcb-f79058ea2950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.459253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9425744d-fde8-4845-9070-b90ba3c6db15 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.468927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:21.486149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-92f66c84-7d06-43ea-9dcb-f79058ea2950 None None] MFA Rules not processed for user `b49632077a2540f094e67cda88976f58`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:21.487826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-92f66c84-7d06-43ea-9dcb-f79058ea2950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:21.515057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:21.521499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.523160 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.524478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.525151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.530185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:21.544489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.546811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.562259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1273/2549] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:21.580865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1277/2550] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:21.605638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:21.608075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:21.696432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b80783-c295-439c-bdfd-e17620f1e0eb service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.703325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8605a5b-8648-4425-8ec0-a3992f7d9a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.704071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8605a5b-8648-4425-8ec0-a3992f7d9a8d service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.704405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8605a5b-8648-4425-8ec0-a3992f7d9a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.705358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8605a5b-8648-4425-8ec0-a3992f7d9a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.719439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8605a5b-8648-4425-8ec0-a3992f7d9a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.721729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8605a5b-8648-4425-8ec0-a3992f7d9a8d service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.755731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1274/2551] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:21.851124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f66c84-7d06-43ea-9dcb-f79058ea2950 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:21.862160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f66c84-7d06-43ea-9dcb-f79058ea2950 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:21.866372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:21.867113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:21.867483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:21.867826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:21.951223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:21.953844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:21.977023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1278/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:23.001997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8b24a-ae95-4be5-88f2-a4f9b21c8fc3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:23.002513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8b24a-ae95-4be5-88f2-a4f9b21c8fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:23.002823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8b24a-ae95-4be5-88f2-a4f9b21c8fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:23.025977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-5fc8b24a-ae95-4be5-88f2-a4f9b21c8fc3 None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:23.027241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5fc8b24a-ae95-4be5-88f2-a4f9b21c8fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:23.086452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1275/2553] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:43:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:23.099864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:23.101692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:23.174169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa0b43-0c71-4a8c-b9e3-d8a7e3dd9bd5 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:23.179759 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1a7ce-3665-4e6a-9c99-3eba2ea92fbd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:23.180362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1a7ce-3665-4e6a-9c99-3eba2ea92fbd service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:23.180638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1a7ce-3665-4e6a-9c99-3eba2ea92fbd service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:23.180976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1a7ce-3665-4e6a-9c99-3eba2ea92fbd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:23.189344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1a7ce-3665-4e6a-9c99-3eba2ea92fbd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:23.191047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c1a7ce-3665-4e6a-9c99-3eba2ea92fbd service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:23.200046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1279/2554] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:43:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:43:33.079113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=72 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:33.196145 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=79 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:38.517032 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50102-e512-4402-b679-b72e6e2060b8 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:38.517544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50102-e512-4402-b679-b72e6e2060b8 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:38.517544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d50102-e512-4402-b679-b72e6e2060b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:38.539607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a4d50102-e512-4402-b679-b72e6e2060b8 None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:38.540827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a4d50102-e512-4402-b679-b72e6e2060b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:38.549004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1276/2555] 10.222.0.48 () {58 vars in 967 bytes} [Sat Sep 17 03:43:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:38.561916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1a7ce-3665-4e6a-9c99-3eba2ea92fbd service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:38.572816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1a7ce-3665-4e6a-9c99-3eba2ea92fbd service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:38.578100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf43b2-baf1-41d5-8b17-b7130555d100 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:38.578826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf43b2-baf1-41d5-8b17-b7130555d100 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:38.579106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf43b2-baf1-41d5-8b17-b7130555d100 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:38.579375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf43b2-baf1-41d5-8b17-b7130555d100 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:38.587904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf43b2-baf1-41d5-8b17-b7130555d100 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:38.589695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf43b2-baf1-41d5-8b17-b7130555d100 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:38.598699 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1280/2556] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 03:43:42.056384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d50102-e512-4402-b679-b72e6e2060b8 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:42.057934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a4d50102-e512-4402-b679-b72e6e2060b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:42.131127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d50102-e512-4402-b679-b72e6e2060b8 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:42.137060 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7251bd6-2e52-473e-b270-8af9f83d0de7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:42.137672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251bd6-2e52-473e-b270-8af9f83d0de7 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:42.138034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251bd6-2e52-473e-b270-8af9f83d0de7 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:42.138247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251bd6-2e52-473e-b270-8af9f83d0de7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:42.140053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c7251bd6-2e52-473e-b270-8af9f83d0de7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:42.152357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7251bd6-2e52-473e-b270-8af9f83d0de7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:42.154017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7251bd6-2e52-473e-b270-8af9f83d0de7 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:42.164475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1277/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:48.595963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:52.154031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf43b2-baf1-41d5-8b17-b7130555d100 service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:52.159914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=37 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:52.224460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf43b2-baf1-41d5-8b17-b7130555d100 service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:52.230273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:52.230897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:52.231172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:52.231433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] PATH_INFO: `/v3/users/601248ea72634bd4aeda0db24577b844` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:52.232683 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=601248ea72634bd4aeda0db24577b844)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:52.234666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:52.285095 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601248ea72634bd4aeda0db24577b844'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.285741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601248ea72634bd4aeda0db24577b844'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.294223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601248ea72634bd4aeda0db24577b844'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.306063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601248ea72634bd4aeda0db24577b844'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.306671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601248ea72634bd4aeda0db24577b844'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.319266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1281/2558] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:43:52 2022] DELETE /identity/v3/users/601248ea72634bd4aeda0db24577b844 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:52.324000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61455-f094-43c1-97b7-2d13f1e675d5 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:52.324312 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61455-f094-43c1-97b7-2d13f1e675d5 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:52.324583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da61455-f094-43c1-97b7-2d13f1e675d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:52.344794 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1da61455-f094-43c1-97b7-2d13f1e675d5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:52.346017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1da61455-f094-43c1-97b7-2d13f1e675d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:52.406669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1278/2559] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:52.416640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:52.418174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:52.476724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50393ad-c5ae-4f51-bfca-256c8495b8aa admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:52.481270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77179e9b-51c6-4802-b9bd-29630e77dfd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:52.481903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179e9b-51c6-4802-b9bd-29630e77dfd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:52.482203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179e9b-51c6-4802-b9bd-29630e77dfd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:52.482490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77179e9b-51c6-4802-b9bd-29630e77dfd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:52.492452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77179e9b-51c6-4802-b9bd-29630e77dfd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:52.493920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77179e9b-51c6-4802-b9bd-29630e77dfd1 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:52.503406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1282/2560] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:52.803185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da61455-f094-43c1-97b7-2d13f1e675d5 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:52.804640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1da61455-f094-43c1-97b7-2d13f1e675d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:52.817141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da61455-f094-43c1-97b7-2d13f1e675d5 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:52.823075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:52.823880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:52.824157 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:52.824420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] PATH_INFO: `/v3/projects/4fc0e843dfa8486ab638a34dd4463d3e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:52.825836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fc0e843dfa8486ab638a34dd4463d3e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:52.828664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:52.877404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fc0e843dfa8486ab638a34dd4463d3e', 'request_id': 'req-d246843e-6297-4ef8-8388-a7435871f0c7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.884041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fc0e843dfa8486ab638a34dd4463d3e', 'request_id': 'req-d246843e-6297-4ef8-8388-a7435871f0c7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.890709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fc0e843dfa8486ab638a34dd4463d3e', 'request_id': 'req-d246843e-6297-4ef8-8388-a7435871f0c7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.905608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] The token cache is being invalidate because project 4fc0e843dfa8486ab638a34dd4463d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:43:52.905920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.906571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:52.908059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1279/2561] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:43:52 2022] DELETE /identity/v3/projects/4fc0e843dfa8486ab638a34dd4463d3e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:52.912264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77179e9b-51c6-4802-b9bd-29630e77dfd1 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:52.922049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77179e9b-51c6-4802-b9bd-29630e77dfd1 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:52.940372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:52.979593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:52.980239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:52.980519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:52.980791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] PATH_INFO: `/v3/users/b49632077a2540f094e67cda88976f58` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:52.982020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b49632077a2540f094e67cda88976f58)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:52.983965 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:53.033204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b49632077a2540f094e67cda88976f58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.033963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b49632077a2540f094e67cda88976f58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.041697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b49632077a2540f094e67cda88976f58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.053629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b49632077a2540f094e67cda88976f58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.054216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-a4eff97e-cc36-4795-854b-79d767a2f76d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b49632077a2540f094e67cda88976f58'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.066510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1283/2562] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:43:52 2022] DELETE /identity/v3/users/b49632077a2540f094e67cda88976f58 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:53.357193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:53.358883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:53.378579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246843e-6297-4ef8-8388-a7435871f0c7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:53.438109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:53.438753 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.439026 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.439300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] PATH_INFO: `/v3/projects/60d5dd97db9d49cf96a19944a2c9bcc1` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.440434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d5dd97db9d49cf96a19944a2c9bcc1)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:53.442384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:53.477028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:53.495091 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d5dd97db9d49cf96a19944a2c9bcc1', 'request_id': 'req-df1a9617-47c9-41b5-9dd7-6e55f54c3139'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.500517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d5dd97db9d49cf96a19944a2c9bcc1', 'request_id': 'req-df1a9617-47c9-41b5-9dd7-6e55f54c3139'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.506637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d5dd97db9d49cf96a19944a2c9bcc1', 'request_id': 'req-df1a9617-47c9-41b5-9dd7-6e55f54c3139'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.522149 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] The token cache is being invalidate because project 60d5dd97db9d49cf96a19944a2c9bcc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:43:53.522434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.523062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-df1a9617-47c9-41b5-9dd7-6e55f54c3139 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:53.524605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1280/2563] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:43:53 2022] DELETE /identity/v3/projects/60d5dd97db9d49cf96a19944a2c9bcc1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:53.529706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8bb9-c7bc-46c8-afc2-a5f29459366a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.530212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8bb9-c7bc-46c8-afc2-a5f29459366a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.530315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb8bb9-c7bc-46c8-afc2-a5f29459366a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.550734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c4fb8bb9-c7bc-46c8-afc2-a5f29459366a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:53.551929 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c4fb8bb9-c7bc-46c8-afc2-a5f29459366a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:53.614420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1284/2564] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:53.622415 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48837ae2-8a43-4aa2-8f41-8267c673644a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.622695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48837ae2-8a43-4aa2-8f41-8267c673644a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.622961 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48837ae2-8a43-4aa2-8f41-8267c673644a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.643675 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-48837ae2-8a43-4aa2-8f41-8267c673644a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:53.644866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-48837ae2-8a43-4aa2-8f41-8267c673644a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:53.653137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1281/2565] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:53.657554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb8bb9-c7bc-46c8-afc2-a5f29459366a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:53.667899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb8bb9-c7bc-46c8-afc2-a5f29459366a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:53.673861 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:53.674460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.674731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.674993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.675637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:43:53.675936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:53.677565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:53.689993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1285/2566] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:43:53.694844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48837ae2-8a43-4aa2-8f41-8267c673644a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:53.708880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48837ae2-8a43-4aa2-8f41-8267c673644a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:53.716910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6e7e6-61bd-4eb6-9c69-0d5ba027c61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:53.717655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e7e6-61bd-4eb6-9c69-0d5ba027c61f admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.718048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e7e6-61bd-4eb6-9c69-0d5ba027c61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.718344 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead6e7e6-61bd-4eb6-9c69-0d5ba027c61f admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.719210 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6e7e6-61bd-4eb6-9c69-0d5ba027c61f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:53.721171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead6e7e6-61bd-4eb6-9c69-0d5ba027c61f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:53.752983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1282/2567] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:43:53 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:43:53.757348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:53.768264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0f680-0724-488d-acd1-cba9b8902ce7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:53.795536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:53.831634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52fde8-7450-423a-a721-346afe5d04b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:53.832269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52fde8-7450-423a-a721-346afe5d04b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.832547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52fde8-7450-423a-a721-346afe5d04b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.832818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52fde8-7450-423a-a721-346afe5d04b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.833452 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52fde8-7450-423a-a721-346afe5d04b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:53.835537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52fde8-7450-423a-a721-346afe5d04b3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:53.858694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1286/2568] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:43:53 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:53.863116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6e7e6-61bd-4eb6-9c69-0d5ba027c61f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:53.873919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead6e7e6-61bd-4eb6-9c69-0d5ba027c61f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:53.878902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32817-c3dd-41c9-ab9f-db3c32b25e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:53.879508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32817-c3dd-41c9-ab9f-db3c32b25e6f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.879821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32817-c3dd-41c9-ab9f-db3c32b25e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.880220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c32817-c3dd-41c9-ab9f-db3c32b25e6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.880773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32817-c3dd-41c9-ab9f-db3c32b25e6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:53.882707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c32817-c3dd-41c9-ab9f-db3c32b25e6f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:53.893217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1283/2569] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:53.897343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52fde8-7450-423a-a721-346afe5d04b3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:53.907529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52fde8-7450-423a-a721-346afe5d04b3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:53.912140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca40094-4b36-4905-942d-06befc516f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:53.912727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40094-4b36-4905-942d-06befc516f8b admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.913004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40094-4b36-4905-942d-06befc516f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.913262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca40094-4b36-4905-942d-06befc516f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.913953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca40094-4b36-4905-942d-06befc516f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:53.915554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca40094-4b36-4905-942d-06befc516f8b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:53.926636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1287/2570] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:43:53.931001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32817-c3dd-41c9-ab9f-db3c32b25e6f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:53.941434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c32817-c3dd-41c9-ab9f-db3c32b25e6f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:53.947216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f75a-ed63-4694-9aaf-bca04c0b2c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:53.947868 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f75a-ed63-4694-9aaf-bca04c0b2c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.948144 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f75a-ed63-4694-9aaf-bca04c0b2c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.948420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555f75a-ed63-4694-9aaf-bca04c0b2c72 admin admin] PATH_INFO: `/v3/projects/cd169149b91b48e9ab08b2c9667f54dc/users/45c89a0e1a3f4fbaacb92eede47a6401/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:53.963700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555f75a-ed63-4694-9aaf-bca04c0b2c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd169149b91b48e9ab08b2c9667f54dc, user_id=45c89a0e1a3f4fbaacb92eede47a6401, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:53.966425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555f75a-ed63-4694-9aaf-bca04c0b2c72 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:53.982299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1284/2571] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:43:53 2022] PUT /identity/v3/projects/cd169149b91b48e9ab08b2c9667f54dc/users/45c89a0e1a3f4fbaacb92eede47a6401/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:53.993114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220272d-8735-4dd0-a188-5c641becc72b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:53.993396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220272d-8735-4dd0-a188-5c641becc72b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:53.993665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2220272d-8735-4dd0-a188-5c641becc72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.021793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2220272d-8735-4dd0-a188-5c641becc72b None None] MFA Rules not processed for user `45c89a0e1a3f4fbaacb92eede47a6401`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:54.023015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2220272d-8735-4dd0-a188-5c641becc72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:54.090692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1288/2572] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:54.095507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f75a-ed63-4694-9aaf-bca04c0b2c72 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:54.161095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555f75a-ed63-4694-9aaf-bca04c0b2c72 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:54.166737 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677c142-6744-453e-8104-57bfa3735e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:54.167341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677c142-6744-453e-8104-57bfa3735e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:54.167612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677c142-6744-453e-8104-57bfa3735e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:54.167877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677c142-6744-453e-8104-57bfa3735e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.168501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677c142-6744-453e-8104-57bfa3735e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:54.170452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677c142-6744-453e-8104-57bfa3735e6b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:54.200040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1285/2573] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:43:54 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:54.204468 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220272d-8735-4dd0-a188-5c641becc72b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:54.215414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2220272d-8735-4dd0-a188-5c641becc72b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:54.273948 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bc2e3-85c9-4e15-94ee-e28aacc9bb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:54.274554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc2e3-85c9-4e15-94ee-e28aacc9bb4a admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:54.274817 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc2e3-85c9-4e15-94ee-e28aacc9bb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:54.275084 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48bc2e3-85c9-4e15-94ee-e28aacc9bb4a admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.275712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bc2e3-85c9-4e15-94ee-e28aacc9bb4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:54.277636 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48bc2e3-85c9-4e15-94ee-e28aacc9bb4a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:54.299871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1289/2574] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:43:54 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:54.304518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677c142-6744-453e-8104-57bfa3735e6b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:54.320166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677c142-6744-453e-8104-57bfa3735e6b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:54.328024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5df48-1b1d-4dc2-b1dd-97db57b3ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:54.328726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5df48-1b1d-4dc2-b1dd-97db57b3ff3f admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:54.329007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5df48-1b1d-4dc2-b1dd-97db57b3ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:54.329275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5df48-1b1d-4dc2-b1dd-97db57b3ff3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.329956 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5df48-1b1d-4dc2-b1dd-97db57b3ff3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:54.331548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5df48-1b1d-4dc2-b1dd-97db57b3ff3f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:54.342335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1286/2575] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:54.347131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bc2e3-85c9-4e15-94ee-e28aacc9bb4a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:54.362270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48bc2e3-85c9-4e15-94ee-e28aacc9bb4a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:54.370176 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eafd6-6829-45a3-850a-0d5e1dc6e3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:54.370828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eafd6-6829-45a3-850a-0d5e1dc6e3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:54.371110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eafd6-6829-45a3-850a-0d5e1dc6e3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:54.371374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2eafd6-6829-45a3-850a-0d5e1dc6e3d6 admin admin] PATH_INFO: `/v3/projects/455e39e4518d4f0ab9bd3381bee1e493/users/7c0cd19963e644139b4e2405d820aa49/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.388705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eafd6-6829-45a3-850a-0d5e1dc6e3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455e39e4518d4f0ab9bd3381bee1e493, user_id=7c0cd19963e644139b4e2405d820aa49, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:54.391415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2eafd6-6829-45a3-850a-0d5e1dc6e3d6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:54.405778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1290/2576] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:43:54 2022] PUT /identity/v3/projects/455e39e4518d4f0ab9bd3381bee1e493/users/7c0cd19963e644139b4e2405d820aa49/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:43:54.410083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5df48-1b1d-4dc2-b1dd-97db57b3ff3f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:54.420239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5df48-1b1d-4dc2-b1dd-97db57b3ff3f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:54.443262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:54.483412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629f320d-f37a-4795-9165-44412842cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:54.484061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f320d-f37a-4795-9165-44412842cbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:54.484307 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f320d-f37a-4795-9165-44412842cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:54.484575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629f320d-f37a-4795-9165-44412842cbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.485211 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f320d-f37a-4795-9165-44412842cbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:54.486869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629f320d-f37a-4795-9165-44412842cbf8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:54.496702 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1287/2577] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:54.501295 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eafd6-6829-45a3-850a-0d5e1dc6e3d6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:54.507062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:54.513655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2eafd6-6829-45a3-850a-0d5e1dc6e3d6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:54.518837 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:54.519586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:54.519863 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:54.520131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] PATH_INFO: `/v3/projects/455e39e4518d4f0ab9bd3381bee1e493/users/7c0cd19963e644139b4e2405d820aa49/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.522092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=455e39e4518d4f0ab9bd3381bee1e493, user_id=7c0cd19963e644139b4e2405d820aa49, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:54.524729 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:54.535347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1291/2578] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:43:54 2022] PUT /identity/v3/projects/455e39e4518d4f0ab9bd3381bee1e493/users/7c0cd19963e644139b4e2405d820aa49/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:54.546834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8df9d-0f87-4309-91d5-3bad2e0e924a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:54.547200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8df9d-0f87-4309-91d5-3bad2e0e924a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:54.547478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8df9d-0f87-4309-91d5-3bad2e0e924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.577202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1fa8df9d-0f87-4309-91d5-3bad2e0e924a None None] MFA Rules not processed for user `7c0cd19963e644139b4e2405d820aa49`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:54.578529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1fa8df9d-0f87-4309-91d5-3bad2e0e924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:54.650304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1288/2579] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:54.661642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:54.663645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:54.724544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bcd2-6da0-44b5-b576-b060d2df1998 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:54.729214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058cc2c-b3ef-4488-a67e-233a76dd93fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:54.729950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058cc2c-b3ef-4488-a67e-233a76dd93fa service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:54.730167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058cc2c-b3ef-4488-a67e-233a76dd93fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:54.730441 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058cc2c-b3ef-4488-a67e-233a76dd93fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:54.740765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058cc2c-b3ef-4488-a67e-233a76dd93fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:54.742290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058cc2c-b3ef-4488-a67e-233a76dd93fa service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:54.751993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1292/2580] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:54 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:55.160342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8df9d-0f87-4309-91d5-3bad2e0e924a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:55.222441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8df9d-0f87-4309-91d5-3bad2e0e924a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:55.227313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:55.227932 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:55.228213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:55.228478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] PATH_INFO: `/v3/users/45c89a0e1a3f4fbaacb92eede47a6401` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:55.229629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c89a0e1a3f4fbaacb92eede47a6401)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:55.231610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:55.282195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c89a0e1a3f4fbaacb92eede47a6401'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.282833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c89a0e1a3f4fbaacb92eede47a6401'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.284487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:55.292084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c89a0e1a3f4fbaacb92eede47a6401'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.299517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c89a0e1a3f4fbaacb92eede47a6401'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.300140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c89a0e1a3f4fbaacb92eede47a6401'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.318308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1289/2581] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:43:55 2022] DELETE /identity/v3/users/45c89a0e1a3f4fbaacb92eede47a6401 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:55.322942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046fc3a-2424-46db-a876-69905f6c5cba None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:55.323224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046fc3a-2424-46db-a876-69905f6c5cba None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:55.323492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046fc3a-2424-46db-a876-69905f6c5cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:55.343437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-9046fc3a-2424-46db-a876-69905f6c5cba None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:55.344830 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9046fc3a-2424-46db-a876-69905f6c5cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:55.412091 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1293/2582] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:55.422277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:55.423795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:55.483115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5626af-3753-4f6c-84d9-6325e389f69c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:55.487318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc7e2-d148-40bd-9974-81605726e6c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:55.487923 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc7e2-d148-40bd-9974-81605726e6c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:55.488190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc7e2-d148-40bd-9974-81605726e6c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:55.488456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfc7e2-d148-40bd-9974-81605726e6c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:55.497997 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfc7e2-d148-40bd-9974-81605726e6c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:55.499444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dfc7e2-d148-40bd-9974-81605726e6c6 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:55.509304 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1290/2583] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:43:55.777365 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046fc3a-2424-46db-a876-69905f6c5cba None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:55.779057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-9046fc3a-2424-46db-a876-69905f6c5cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:55.793640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046fc3a-2424-46db-a876-69905f6c5cba None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:55.798408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:55.799175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:55.799490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:55.799728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] PATH_INFO: `/v3/projects/cd169149b91b48e9ab08b2c9667f54dc` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:55.800984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd169149b91b48e9ab08b2c9667f54dc)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:55.802918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:55.852271 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd169149b91b48e9ab08b2c9667f54dc', 'request_id': 'req-485da2cd-2dca-4aa7-a326-49b50c98c50f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.858518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd169149b91b48e9ab08b2c9667f54dc', 'request_id': 'req-485da2cd-2dca-4aa7-a326-49b50c98c50f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.868190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd169149b91b48e9ab08b2c9667f54dc', 'request_id': 'req-485da2cd-2dca-4aa7-a326-49b50c98c50f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.879026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] The token cache is being invalidate because project cd169149b91b48e9ab08b2c9667f54dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:43:55.879309 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.879941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:55.881692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1294/2584] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:43:55 2022] DELETE /identity/v3/projects/cd169149b91b48e9ab08b2c9667f54dc => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:55.886169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc7e2-d148-40bd-9974-81605726e6c6 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:55.896002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfc7e2-d148-40bd-9974-81605726e6c6 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:55.957973 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:55.959025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:55.959308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:55.959624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] PATH_INFO: `/v3/users/7c0cd19963e644139b4e2405d820aa49` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:55.961417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0cd19963e644139b4e2405d820aa49)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:55.964411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:56.014585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0cd19963e644139b4e2405d820aa49'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.015239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0cd19963e644139b4e2405d820aa49'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.023926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0cd19963e644139b4e2405d820aa49'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.031055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0cd19963e644139b4e2405d820aa49'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.031791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d3491361-170f-4efa-8e84-2d8cfee5e04f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0cd19963e644139b4e2405d820aa49'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.037012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:56.050759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1291/2585] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:43:55 2022] DELETE /identity/v3/users/7c0cd19963e644139b4e2405d820aa49 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:56.334001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:56.335633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:56.349628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485da2cd-2dca-4aa7-a326-49b50c98c50f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:56.362448 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:56.411400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:56.412024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.412298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.412565 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] PATH_INFO: `/v3/projects/455e39e4518d4f0ab9bd3381bee1e493` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.413724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] RBAC: Authorizing `identity:delete_project(project_id=455e39e4518d4f0ab9bd3381bee1e493)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:56.415644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:56.467316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '455e39e4518d4f0ab9bd3381bee1e493', 'request_id': 'req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.473603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '455e39e4518d4f0ab9bd3381bee1e493', 'request_id': 'req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.484139 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '455e39e4518d4f0ab9bd3381bee1e493', 'request_id': 'req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.497385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] The token cache is being invalidate because project 455e39e4518d4f0ab9bd3381bee1e493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:43:56.497701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.498353 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-8a6a00c8-20a1-453c-bff4-f0cf7fe3455d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:43:56.499885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1295/2586] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:43:56 2022] DELETE /identity/v3/projects/455e39e4518d4f0ab9bd3381bee1e493 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:56.505010 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726536f8-2d75-49c1-9e6d-eff6eefd8d4b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.505486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726536f8-2d75-49c1-9e6d-eff6eefd8d4b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.505599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726536f8-2d75-49c1-9e6d-eff6eefd8d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.526323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-726536f8-2d75-49c1-9e6d-eff6eefd8d4b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:56.527523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-726536f8-2d75-49c1-9e6d-eff6eefd8d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:56.595626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1292/2587] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:56.607700 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c430-2d88-4bf7-9702-ba44e8a61be3 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.608076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c430-2d88-4bf7-9702-ba44e8a61be3 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.608393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8c430-2d88-4bf7-9702-ba44e8a61be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.632714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d5d8c430-2d88-4bf7-9702-ba44e8a61be3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:56.634335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d5d8c430-2d88-4bf7-9702-ba44e8a61be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:56.642879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1296/2588] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:56.647277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726536f8-2d75-49c1-9e6d-eff6eefd8d4b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:56.657075 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726536f8-2d75-49c1-9e6d-eff6eefd8d4b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:56.662051 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:56.662654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.662954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.663225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.663884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:43:56.664184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:56.665872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:56.677593 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1293/2589] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:43:56.682048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c430-2d88-4bf7-9702-ba44e8a61be3 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:56.691556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8c430-2d88-4bf7-9702-ba44e8a61be3 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:56.696806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261acc79-8d0b-419d-b4fa-0fd1427b4f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:56.697398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261acc79-8d0b-419d-b4fa-0fd1427b4f6c admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.697692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261acc79-8d0b-419d-b4fa-0fd1427b4f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.697972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261acc79-8d0b-419d-b4fa-0fd1427b4f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.698595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261acc79-8d0b-419d-b4fa-0fd1427b4f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:56.700479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261acc79-8d0b-419d-b4fa-0fd1427b4f6c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:56.730387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1297/2590] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:43:56 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:56.736550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:56.751600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead5880-b79a-46a6-b876-b13af7998a70 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:56.814137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9172a59-5926-43c6-b1df-4ee8c6cfa64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:56.814767 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9172a59-5926-43c6-b1df-4ee8c6cfa64a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.815041 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9172a59-5926-43c6-b1df-4ee8c6cfa64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.815309 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9172a59-5926-43c6-b1df-4ee8c6cfa64a admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.815928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9172a59-5926-43c6-b1df-4ee8c6cfa64a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:56.817877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9172a59-5926-43c6-b1df-4ee8c6cfa64a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:56.840646 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1294/2591] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:43:56 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:43:56.845177 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261acc79-8d0b-419d-b4fa-0fd1427b4f6c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:56.856193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261acc79-8d0b-419d-b4fa-0fd1427b4f6c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:56.861286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8828b8-b391-48d4-8394-d07af33055ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:56.861913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8828b8-b391-48d4-8394-d07af33055ef admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.862188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8828b8-b391-48d4-8394-d07af33055ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.862456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8828b8-b391-48d4-8394-d07af33055ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.863102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8828b8-b391-48d4-8394-d07af33055ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:56.864695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8828b8-b391-48d4-8394-d07af33055ef admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:56.874870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1298/2592] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:56.879161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9172a59-5926-43c6-b1df-4ee8c6cfa64a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:56.890302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9172a59-5926-43c6-b1df-4ee8c6cfa64a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:56.894936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b7d495-c028-4bee-98f5-48ca25a47135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:56.895571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7d495-c028-4bee-98f5-48ca25a47135 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.895838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7d495-c028-4bee-98f5-48ca25a47135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.896098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b7d495-c028-4bee-98f5-48ca25a47135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.896732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7d495-c028-4bee-98f5-48ca25a47135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:56.898368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b7d495-c028-4bee-98f5-48ca25a47135 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:56.909000 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1295/2593] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:43:56.913323 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8828b8-b391-48d4-8394-d07af33055ef admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:56.923415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8828b8-b391-48d4-8394-d07af33055ef admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:56.928803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:56.929410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.929684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.929980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] PATH_INFO: `/v3/projects/ed48b78151004bc0a8c190244d762570/users/99451cd89a294cc18482c54489011dfa/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:56.945278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed48b78151004bc0a8c190244d762570, user_id=99451cd89a294cc18482c54489011dfa, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:56.948004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:56.962600 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1299/2594] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:43:56 2022] PUT /identity/v3/projects/ed48b78151004bc0a8c190244d762570/users/99451cd89a294cc18482c54489011dfa/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:43:56.974040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fddf06-3a97-4dfe-89da-41c0709a663c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:56.974321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fddf06-3a97-4dfe-89da-41c0709a663c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:56.974584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fddf06-3a97-4dfe-89da-41c0709a663c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:57.002070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-88fddf06-3a97-4dfe-89da-41c0709a663c None None] MFA Rules not processed for user `99451cd89a294cc18482c54489011dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:43:57.003275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-88fddf06-3a97-4dfe-89da-41c0709a663c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:57.045772 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:57.070174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1296/2595] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:43:57.081421 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:43:57.083248 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:43:57.260960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:43:57.273462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f74203f-805c-4dd4-9943-b7b5a163f7f3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:43:57.278255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caf0d8-4564-44b4-8b52-5e6b6f84e2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:43:57.279206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf0d8-4564-44b4-8b52-5e6b6f84e2ce service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:43:57.279515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf0d8-4564-44b4-8b52-5e6b6f84e2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:43:57.279791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caf0d8-4564-44b4-8b52-5e6b6f84e2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:43:57.290496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2caf0d8-4564-44b4-8b52-5e6b6f84e2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:43:57.290496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2caf0d8-4564-44b4-8b52-5e6b6f84e2ce service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:43:57.299652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1300/2596] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:43:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:02.753618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fddf06-3a97-4dfe-89da-41c0709a663c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:02.818512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fddf06-3a97-4dfe-89da-41c0709a663c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:02.824902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:02.825508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:02.825807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:02.826072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] PATH_INFO: `/v3/users/99451cd89a294cc18482c54489011dfa` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:02.827443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99451cd89a294cc18482c54489011dfa)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:02.829435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:02.878345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99451cd89a294cc18482c54489011dfa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:02.879047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99451cd89a294cc18482c54489011dfa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:02.887813 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99451cd89a294cc18482c54489011dfa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:02.894873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99451cd89a294cc18482c54489011dfa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:02.895494 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99451cd89a294cc18482c54489011dfa'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:02.912327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1297/2597] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:02 2022] DELETE /identity/v3/users/99451cd89a294cc18482c54489011dfa => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:02.917831 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24b9e-e12e-4a94-bdaa-3cb44e948fa5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:02.918343 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24b9e-e12e-4a94-bdaa-3cb44e948fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:02.918449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a24b9e-e12e-4a94-bdaa-3cb44e948fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:02.938470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-77a24b9e-e12e-4a94-bdaa-3cb44e948fa5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:02.939658 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-77a24b9e-e12e-4a94-bdaa-3cb44e948fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:02.999634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1301/2598] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:03.010039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:03.011459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:03.076347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ffaf7-fe76-4530-9b78-56ad853cf379 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:03.080474 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f874c08-7529-4864-838f-790a84909291 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:03.081093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874c08-7529-4864-838f-790a84909291 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.081372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874c08-7529-4864-838f-790a84909291 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.081640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f874c08-7529-4864-838f-790a84909291 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.091135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f874c08-7529-4864-838f-790a84909291 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:03.092585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f874c08-7529-4864-838f-790a84909291 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:03.102100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1298/2599] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:03.386989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a24b9e-e12e-4a94-bdaa-3cb44e948fa5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:03.388816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-77a24b9e-e12e-4a94-bdaa-3cb44e948fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:03.403634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a24b9e-e12e-4a94-bdaa-3cb44e948fa5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:03.408833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:03.409506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.409809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.410089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] PATH_INFO: `/v3/projects/ed48b78151004bc0a8c190244d762570` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.411278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed48b78151004bc0a8c190244d762570)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:03.413266 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:03.461433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed48b78151004bc0a8c190244d762570', 'request_id': 'req-e611edf9-263d-4a21-bb97-094a28141e61'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:03.468069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed48b78151004bc0a8c190244d762570', 'request_id': 'req-e611edf9-263d-4a21-bb97-094a28141e61'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:03.476962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed48b78151004bc0a8c190244d762570', 'request_id': 'req-e611edf9-263d-4a21-bb97-094a28141e61'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:03.488502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] The token cache is being invalidate because project ed48b78151004bc0a8c190244d762570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:03.488806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:03.489446 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e611edf9-263d-4a21-bb97-094a28141e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:03.491100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1302/2600] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:03 2022] DELETE /identity/v3/projects/ed48b78151004bc0a8c190244d762570 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:44:03.496508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df3fdb-4dd1-48ec-9358-6f81add50795 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.496801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df3fdb-4dd1-48ec-9358-6f81add50795 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.497076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1df3fdb-4dd1-48ec-9358-6f81add50795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.506611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:03.518719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f1df3fdb-4dd1-48ec-9358-6f81add50795 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:03.520838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f1df3fdb-4dd1-48ec-9358-6f81add50795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:03.581133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1299/2601] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:03.592470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54368-4e0c-4327-965a-f4240d2f207c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.592757 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54368-4e0c-4327-965a-f4240d2f207c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.593048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54368-4e0c-4327-965a-f4240d2f207c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.619024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-45c54368-4e0c-4327-965a-f4240d2f207c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:03.620294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-45c54368-4e0c-4327-965a-f4240d2f207c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:03.629021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1303/2602] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:03.633434 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df3fdb-4dd1-48ec-9358-6f81add50795 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:03.644104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1df3fdb-4dd1-48ec-9358-6f81add50795 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:03.649242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:03.649872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.650147 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.650411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.651442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:44:03.651779 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:03.653397 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:03.665422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1300/2603] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:44:03.669842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c54368-4e0c-4327-965a-f4240d2f207c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:03.679797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c54368-4e0c-4327-965a-f4240d2f207c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:03.685187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971843c2-cf44-4468-91f9-07ec6ffdd4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:03.685780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971843c2-cf44-4468-91f9-07ec6ffdd4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.686079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971843c2-cf44-4468-91f9-07ec6ffdd4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.686342 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971843c2-cf44-4468-91f9-07ec6ffdd4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.686968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971843c2-cf44-4468-91f9-07ec6ffdd4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:03.688850 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971843c2-cf44-4468-91f9-07ec6ffdd4e5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:03.720055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1304/2604] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:03 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:03.724414 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:03.736516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59f8a-c1df-426c-9f93-80e83cc9b4cd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:03.804914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b37731-eae6-4b3a-871d-5cd37aa62da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:03.806035 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37731-eae6-4b3a-871d-5cd37aa62da8 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.806461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37731-eae6-4b3a-871d-5cd37aa62da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.806839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b37731-eae6-4b3a-871d-5cd37aa62da8 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.807862 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b37731-eae6-4b3a-871d-5cd37aa62da8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:03.811133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b37731-eae6-4b3a-871d-5cd37aa62da8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:03.838103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1301/2605] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:03 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:03.842436 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971843c2-cf44-4468-91f9-07ec6ffdd4e5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:03.853936 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971843c2-cf44-4468-91f9-07ec6ffdd4e5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:03.859550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420f0c9-dfa5-46a7-9bd9-8785a790c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:03.860133 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420f0c9-dfa5-46a7-9bd9-8785a790c5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.860536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420f0c9-dfa5-46a7-9bd9-8785a790c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.860793 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420f0c9-dfa5-46a7-9bd9-8785a790c5c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.861422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420f0c9-dfa5-46a7-9bd9-8785a790c5c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:03.863031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420f0c9-dfa5-46a7-9bd9-8785a790c5c1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:03.873219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1305/2606] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:44:03.877405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b37731-eae6-4b3a-871d-5cd37aa62da8 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:03.889225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b37731-eae6-4b3a-871d-5cd37aa62da8 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:03.894622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50ada5-6c58-43a5-af42-2f53b3ba88d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:03.895229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ada5-6c58-43a5-af42-2f53b3ba88d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.895508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ada5-6c58-43a5-af42-2f53b3ba88d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.895778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50ada5-6c58-43a5-af42-2f53b3ba88d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.896418 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ada5-6c58-43a5-af42-2f53b3ba88d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:03.898117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50ada5-6c58-43a5-af42-2f53b3ba88d7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:03.909299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1302/2607] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:03.913874 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420f0c9-dfa5-46a7-9bd9-8785a790c5c1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:03.924352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420f0c9-dfa5-46a7-9bd9-8785a790c5c1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:03.930317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404fc09-3e66-4fb7-be3e-f0ed8cc8ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:03.930980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404fc09-3e66-4fb7-be3e-f0ed8cc8ccce admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.931261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404fc09-3e66-4fb7-be3e-f0ed8cc8ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.931553 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0404fc09-3e66-4fb7-be3e-f0ed8cc8ccce admin admin] PATH_INFO: `/v3/projects/24e8305066794476982b57f1d6c10ca5/users/86aab7c0a9c341e9ae3c315ad44e274c/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:03.947021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404fc09-3e66-4fb7-be3e-f0ed8cc8ccce admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e8305066794476982b57f1d6c10ca5, user_id=86aab7c0a9c341e9ae3c315ad44e274c, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:03.950028 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0404fc09-3e66-4fb7-be3e-f0ed8cc8ccce admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:03.968798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1306/2608] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:03 2022] PUT /identity/v3/projects/24e8305066794476982b57f1d6c10ca5/users/86aab7c0a9c341e9ae3c315ad44e274c/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:03.980050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf4ae-ea41-4444-abf0-478cb0b68267 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:03.980174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf4ae-ea41-4444-abf0-478cb0b68267 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:03.980456 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3accf4ae-ea41-4444-abf0-478cb0b68267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.014662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3accf4ae-ea41-4444-abf0-478cb0b68267 None None] MFA Rules not processed for user `86aab7c0a9c341e9ae3c315ad44e274c`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:04.015880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3accf4ae-ea41-4444-abf0-478cb0b68267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:04.093622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:04.102072 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1303/2609] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:04.107246 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404fc09-3e66-4fb7-be3e-f0ed8cc8ccce admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:04.119102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:04.178391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0404fc09-3e66-4fb7-be3e-f0ed8cc8ccce admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:04.183880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ec6ad-1f84-4502-a308-85517c637ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:04.184490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec6ad-1f84-4502-a308-85517c637ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:04.184764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec6ad-1f84-4502-a308-85517c637ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:04.185040 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec6ad-1f84-4502-a308-85517c637ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.185681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec6ad-1f84-4502-a308-85517c637ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:04.187627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec6ad-1f84-4502-a308-85517c637ae3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:04.217392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1307/2610] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:04 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:04.221673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accf4ae-ea41-4444-abf0-478cb0b68267 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:04.233618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3accf4ae-ea41-4444-abf0-478cb0b68267 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:04.304028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72743347-e212-4860-a4bf-bb4be2d3dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:04.304620 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743347-e212-4860-a4bf-bb4be2d3dff0 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:04.304900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743347-e212-4860-a4bf-bb4be2d3dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:04.305167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743347-e212-4860-a4bf-bb4be2d3dff0 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.305801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72743347-e212-4860-a4bf-bb4be2d3dff0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:04.307792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72743347-e212-4860-a4bf-bb4be2d3dff0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:04.333299 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1304/2611] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:04 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:04.337398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ec6ad-1f84-4502-a308-85517c637ae3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:04.348457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ec6ad-1f84-4502-a308-85517c637ae3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:04.354290 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6696390-c19b-4ca7-9a3c-06ff5567d28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:04.354879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6696390-c19b-4ca7-9a3c-06ff5567d28e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:04.355152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6696390-c19b-4ca7-9a3c-06ff5567d28e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:04.355414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6696390-c19b-4ca7-9a3c-06ff5567d28e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.356030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6696390-c19b-4ca7-9a3c-06ff5567d28e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:04.357603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6696390-c19b-4ca7-9a3c-06ff5567d28e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:04.367907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1308/2612] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:44:04.371893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72743347-e212-4860-a4bf-bb4be2d3dff0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:04.382077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72743347-e212-4860-a4bf-bb4be2d3dff0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:04.387425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0def2-2fa5-4ac2-b8f3-e37df4191c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:04.388148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0def2-2fa5-4ac2-b8f3-e37df4191c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:04.388452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0def2-2fa5-4ac2-b8f3-e37df4191c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:04.388720 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0def2-2fa5-4ac2-b8f3-e37df4191c6c admin admin] PATH_INFO: `/v3/projects/286fa3b932f7483582c78e3f8a162c70/users/165b6102bf364fdab520f9bdcddc7b8a/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.406218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0def2-2fa5-4ac2-b8f3-e37df4191c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=286fa3b932f7483582c78e3f8a162c70, user_id=165b6102bf364fdab520f9bdcddc7b8a, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:04.408884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0def2-2fa5-4ac2-b8f3-e37df4191c6c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:04.428944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1305/2613] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:04 2022] PUT /identity/v3/projects/286fa3b932f7483582c78e3f8a162c70/users/165b6102bf364fdab520f9bdcddc7b8a/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:04.433134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6696390-c19b-4ca7-9a3c-06ff5567d28e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:04.444287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6696390-c19b-4ca7-9a3c-06ff5567d28e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:04.516042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d45aeed-d83e-422e-b450-ac3e729e1550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:04.516643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45aeed-d83e-422e-b450-ac3e729e1550 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:04.516938 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45aeed-d83e-422e-b450-ac3e729e1550 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:04.517202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d45aeed-d83e-422e-b450-ac3e729e1550 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.517866 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45aeed-d83e-422e-b450-ac3e729e1550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:04.519453 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d45aeed-d83e-422e-b450-ac3e729e1550 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:04.529517 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1309/2614] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:04.533994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0def2-2fa5-4ac2-b8f3-e37df4191c6c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:04.544829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0def2-2fa5-4ac2-b8f3-e37df4191c6c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:04.550582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:04.551229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:04.551624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:04.551893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] PATH_INFO: `/v3/projects/286fa3b932f7483582c78e3f8a162c70/users/165b6102bf364fdab520f9bdcddc7b8a/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.554115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=286fa3b932f7483582c78e3f8a162c70, user_id=165b6102bf364fdab520f9bdcddc7b8a, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:04.556803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:04.567217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1306/2615] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:04 2022] PUT /identity/v3/projects/286fa3b932f7483582c78e3f8a162c70/users/165b6102bf364fdab520f9bdcddc7b8a/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:04.633315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044c7b-f741-4dff-a125-833b58ca4672 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:04.633931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044c7b-f741-4dff-a125-833b58ca4672 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:04.634217 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4044c7b-f741-4dff-a125-833b58ca4672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.665449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e4044c7b-f741-4dff-a125-833b58ca4672 None None] MFA Rules not processed for user `165b6102bf364fdab520f9bdcddc7b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:04.666693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e4044c7b-f741-4dff-a125-833b58ca4672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:04.739384 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:04.743390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1310/2616] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:04.754607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:04.756575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:04.817006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4a8bc-8e95-413b-8d22-f7e70bed77ce admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:04.820924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414be7e-e83c-48ab-bd5d-6ad2b39ef3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:04.821551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414be7e-e83c-48ab-bd5d-6ad2b39ef3dc service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:04.821854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414be7e-e83c-48ab-bd5d-6ad2b39ef3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:04.822108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414be7e-e83c-48ab-bd5d-6ad2b39ef3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:04.879348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414be7e-e83c-48ab-bd5d-6ad2b39ef3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:04.880836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414be7e-e83c-48ab-bd5d-6ad2b39ef3dc service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:04.890330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1307/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:07.462810 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044c7b-f741-4dff-a125-833b58ca4672 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:07.525947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4044c7b-f741-4dff-a125-833b58ca4672 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:07.531264 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:07.531892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:07.532165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:07.532431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] PATH_INFO: `/v3/users/86aab7c0a9c341e9ae3c315ad44e274c` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:07.533605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] RBAC: Authorizing `identity:delete_user(user_id=86aab7c0a9c341e9ae3c315ad44e274c)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:07.535665 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:07.586419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86aab7c0a9c341e9ae3c315ad44e274c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:07.587151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86aab7c0a9c341e9ae3c315ad44e274c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:07.596887 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86aab7c0a9c341e9ae3c315ad44e274c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:07.609151 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86aab7c0a9c341e9ae3c315ad44e274c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:07.609872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86aab7c0a9c341e9ae3c315ad44e274c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:07.622396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1311/2618] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:07 2022] DELETE /identity/v3/users/86aab7c0a9c341e9ae3c315ad44e274c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:07.627125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb56d4-0fe5-401f-984f-f35f150b7c18 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:07.627618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb56d4-0fe5-401f-984f-f35f150b7c18 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:07.627725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb56d4-0fe5-401f-984f-f35f150b7c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:07.641993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:07.648537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-94bb56d4-0fe5-401f-984f-f35f150b7c18 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:07.650353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-94bb56d4-0fe5-401f-984f-f35f150b7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:07.724486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1308/2619] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:07.734577 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:07.736072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:07.796494 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4a84f-03f9-4773-b851-a1357333299c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:07.801012 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc45402-fd3f-435e-85f6-ac6abd25f092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:07.801615 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45402-fd3f-435e-85f6-ac6abd25f092 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:07.801919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45402-fd3f-435e-85f6-ac6abd25f092 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:07.802187 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc45402-fd3f-435e-85f6-ac6abd25f092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:07.811433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc45402-fd3f-435e-85f6-ac6abd25f092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:07.812864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc45402-fd3f-435e-85f6-ac6abd25f092 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:07.822239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1312/2620] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:08.108395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb56d4-0fe5-401f-984f-f35f150b7c18 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:08.109991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-94bb56d4-0fe5-401f-984f-f35f150b7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:08.123078 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb56d4-0fe5-401f-984f-f35f150b7c18 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:08.129219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:08.129959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:08.130319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:08.130579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] PATH_INFO: `/v3/projects/24e8305066794476982b57f1d6c10ca5` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:08.131809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e8305066794476982b57f1d6c10ca5)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:08.134286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:08.182652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e8305066794476982b57f1d6c10ca5', 'request_id': 'req-67845104-7200-4e6f-937b-af4f1e0971a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.188509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e8305066794476982b57f1d6c10ca5', 'request_id': 'req-67845104-7200-4e6f-937b-af4f1e0971a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.195268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e8305066794476982b57f1d6c10ca5', 'request_id': 'req-67845104-7200-4e6f-937b-af4f1e0971a7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.209375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] The token cache is being invalidate because project 24e8305066794476982b57f1d6c10ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:08.209678 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.210336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.211901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1309/2621] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:08 2022] DELETE /identity/v3/projects/24e8305066794476982b57f1d6c10ca5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:08.216113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc45402-fd3f-435e-85f6-ac6abd25f092 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:08.226038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc45402-fd3f-435e-85f6-ac6abd25f092 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:08.244802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:08.284721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:08.285380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:08.285657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:08.285957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] PATH_INFO: `/v3/users/165b6102bf364fdab520f9bdcddc7b8a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:08.287098 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=165b6102bf364fdab520f9bdcddc7b8a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:08.289002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:08.347722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '165b6102bf364fdab520f9bdcddc7b8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.348414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '165b6102bf364fdab520f9bdcddc7b8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.356885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '165b6102bf364fdab520f9bdcddc7b8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.369102 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '165b6102bf364fdab520f9bdcddc7b8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.369858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-78d7959c-0028-47ca-959c-bf8fc7e7b98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '165b6102bf364fdab520f9bdcddc7b8a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.382942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1313/2622] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:08 2022] DELETE /identity/v3/users/165b6102bf364fdab520f9bdcddc7b8a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:08.658500 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:08.660603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:08.677154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67845104-7200-4e6f-937b-af4f1e0971a7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:08.736233 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:08.736793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:08.737079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:08.737345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] PATH_INFO: `/v3/projects/286fa3b932f7483582c78e3f8a162c70` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:08.738595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=286fa3b932f7483582c78e3f8a162c70)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:08.740556 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:08.776780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:08.791111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286fa3b932f7483582c78e3f8a162c70', 'request_id': 'req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.796679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286fa3b932f7483582c78e3f8a162c70', 'request_id': 'req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.802857 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286fa3b932f7483582c78e3f8a162c70', 'request_id': 'req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.815898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] The token cache is being invalidate because project 286fa3b932f7483582c78e3f8a162c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:08.816207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.816854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ed1e9a3a-0493-409d-960a-ea4efcc7be6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:08.818398 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1310/2623] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:08 2022] DELETE /identity/v3/projects/286fa3b932f7483582c78e3f8a162c70 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:08.823390 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2293-f083-4a09-943f-95e2fa68f179 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:08.823855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2293-f083-4a09-943f-95e2fa68f179 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:08.823950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b2293-f083-4a09-943f-95e2fa68f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:08.844211 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-5f5b2293-f083-4a09-943f-95e2fa68f179 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:08.845412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5f5b2293-f083-4a09-943f-95e2fa68f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:08.907991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1314/2624] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:44:08.916016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd02c5-3059-4c22-93a3-8450537ec8fe None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:08.916301 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd02c5-3059-4c22-93a3-8450537ec8fe None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:08.916571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd02c5-3059-4c22-93a3-8450537ec8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:08.938498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cecd02c5-3059-4c22-93a3-8450537ec8fe None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:08.939806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cecd02c5-3059-4c22-93a3-8450537ec8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:08.948954 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1311/2625] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:08.953469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2293-f083-4a09-943f-95e2fa68f179 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:08.963302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b2293-f083-4a09-943f-95e2fa68f179 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:08.968254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:08.968855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:08.969138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:08.969408 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:08.970112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:44:08.970416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:08.972011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:08.983897 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1315/2626] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:44:08.988428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd02c5-3059-4c22-93a3-8450537ec8fe None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:08.997897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd02c5-3059-4c22-93a3-8450537ec8fe None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:09.002872 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0ee9-d470-430b-9480-93f2c2183a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:09.003473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0ee9-d470-430b-9480-93f2c2183a14 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:09.003859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0ee9-d470-430b-9480-93f2c2183a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:09.004125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe0ee9-d470-430b-9480-93f2c2183a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:09.004754 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe0ee9-d470-430b-9480-93f2c2183a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:09.006691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fe0ee9-d470-430b-9480-93f2c2183a14 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:09.036261 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1312/2627] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:08 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:09.040679 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:09.050868 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f6c4-1f5a-4be6-b89f-36fabf3a9bbc admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:09.078184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:09.112243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210f90-6c1f-4162-8026-ec4d10139ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:09.112844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210f90-6c1f-4162-8026-ec4d10139ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:09.113147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210f90-6c1f-4162-8026-ec4d10139ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:09.113416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68210f90-6c1f-4162-8026-ec4d10139ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:09.114082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68210f90-6c1f-4162-8026-ec4d10139ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:09.115990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68210f90-6c1f-4162-8026-ec4d10139ab4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:09.143208 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1316/2628] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:09 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:44:09.147685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0ee9-d470-430b-9480-93f2c2183a14 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:09.158400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fe0ee9-d470-430b-9480-93f2c2183a14 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:09.164399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e4f3-f169-473d-ab5b-47aba241049a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:09.165001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e4f3-f169-473d-ab5b-47aba241049a admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:09.165357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e4f3-f169-473d-ab5b-47aba241049a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:09.165550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399e4f3-f169-473d-ab5b-47aba241049a admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:09.166205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399e4f3-f169-473d-ab5b-47aba241049a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:09.167811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399e4f3-f169-473d-ab5b-47aba241049a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:09.178292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1313/2629] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:44:09.182303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210f90-6c1f-4162-8026-ec4d10139ab4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:09.193031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68210f90-6c1f-4162-8026-ec4d10139ab4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:09.199513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccb22d-86e3-426e-99fe-976bd13cf59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:09.200113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb22d-86e3-426e-99fe-976bd13cf59c admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:09.200387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb22d-86e3-426e-99fe-976bd13cf59c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:09.200681 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccb22d-86e3-426e-99fe-976bd13cf59c admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:09.201324 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccb22d-86e3-426e-99fe-976bd13cf59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:09.202979 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccb22d-86e3-426e-99fe-976bd13cf59c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:09.214445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1317/2630] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:09.218773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e4f3-f169-473d-ab5b-47aba241049a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:09.228864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399e4f3-f169-473d-ab5b-47aba241049a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:09.233880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:09.234526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:09.234803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:09.235069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] PATH_INFO: `/v3/projects/2111cd52edcf4c9b83fad77dd2b32956/users/844e860b3c6a40ff9ae1c59b61a27d08/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:09.249920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2111cd52edcf4c9b83fad77dd2b32956, user_id=844e860b3c6a40ff9ae1c59b61a27d08, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:09.252512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:09.268276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1314/2631] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:09 2022] PUT /identity/v3/projects/2111cd52edcf4c9b83fad77dd2b32956/users/844e860b3c6a40ff9ae1c59b61a27d08/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:09.273603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227294-e4ef-408b-a93b-a6562ed348cc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:09.273919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227294-e4ef-408b-a93b-a6562ed348cc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:09.274195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227294-e4ef-408b-a93b-a6562ed348cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:09.292848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-90227294-e4ef-408b-a93b-a6562ed348cc None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:09.294057 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-90227294-e4ef-408b-a93b-a6562ed348cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:09.360167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1318/2632] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:09.370985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:09.372814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:09.433117 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191da06-a60d-4c1a-a045-fc4963ed30ca admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:09.437269 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:09.437898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:09.438171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:09.438433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:09.447745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:09.449172 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:09.458569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1315/2633] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:10.099294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4021e5-31b3-413c-84a7-c41a215354eb None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:10.099869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4021e5-31b3-413c-84a7-c41a215354eb None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:10.099869 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4021e5-31b3-413c-84a7-c41a215354eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:10.130765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ae4021e5-31b3-413c-84a7-c41a215354eb None None] MFA Rules not processed for user `844e860b3c6a40ff9ae1c59b61a27d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:10.132008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ae4021e5-31b3-413c-84a7-c41a215354eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:10.202097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1319/2634] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:10.213277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:10.214901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:10.276058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefc251-672d-4440-a89a-224d5b1ebad0 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:10.280089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:10.280870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:10.281161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:10.281432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:10.290935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:10.292508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:10.302249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1316/2635] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:11.687813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3e56f-22bb-48b1-a1ff-99c86bbbb3ae None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:11.688387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3e56f-22bb-48b1-a1ff-99c86bbbb3ae None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:11.688387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3e56f-22bb-48b1-a1ff-99c86bbbb3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:11.708229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-caf3e56f-22bb-48b1-a1ff-99c86bbbb3ae None None] MFA Rules not processed for user `844e860b3c6a40ff9ae1c59b61a27d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:11.709420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-caf3e56f-22bb-48b1-a1ff-99c86bbbb3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:11.717501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1320/2636] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:20.297874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:21.702961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:22.405797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:22.407228 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:22.420950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14832c0-5049-44cf-9039-01b210d22826 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:22.424663 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:22.425276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:22.425552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:22.425860 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:22.427615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:22.445028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:22.446661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:22.458268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1317/2637] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:23.441008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6773-3380-498e-b488-c7d0a49f8e30 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:23.441556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6773-3380-498e-b488-c7d0a49f8e30 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:23.441660 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb6773-3380-498e-b488-c7d0a49f8e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:23.461716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-68bb6773-3380-498e-b488-c7d0a49f8e30 None None] MFA Rules not processed for user `8f119e7a0b66415ab88cd641886c2e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:23.463213 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-68bb6773-3380-498e-b488-c7d0a49f8e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:23.520933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1321/2638] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:25.997437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:25.999547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:26.027302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fae982-e459-4f8e-a2a4-d51f87845511 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:26.034575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:26.035673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:26.036155 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:26.036515 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] PATH_INFO: `/v3/users/f2f6fd1b96d44bde897fa70cfd5459f9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:26.037874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f6fd1b96d44bde897fa70cfd5459f9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:26.040985 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:26.120641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f6fd1b96d44bde897fa70cfd5459f9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.127378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f6fd1b96d44bde897fa70cfd5459f9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.138781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f6fd1b96d44bde897fa70cfd5459f9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.150202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f6fd1b96d44bde897fa70cfd5459f9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.151043 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-0f2190ab-6ea8-4814-9e1e-11232e5e6bff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f6fd1b96d44bde897fa70cfd5459f9'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.171524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1318/2639] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:25 2022] DELETE /identity/v3/users/f2f6fd1b96d44bde897fa70cfd5459f9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:26.459114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb6773-3380-498e-b488-c7d0a49f8e30 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:26.472362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb6773-3380-498e-b488-c7d0a49f8e30 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:26.561848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:26.562564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:26.562842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:26.563135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] PATH_INFO: `/v3/projects/fc39540e3c13425797fca427caf460a5` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:26.564339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc39540e3c13425797fca427caf460a5)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:26.566328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:26.623804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc39540e3c13425797fca427caf460a5', 'request_id': 'req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.630449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc39540e3c13425797fca427caf460a5', 'request_id': 'req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.643406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc39540e3c13425797fca427caf460a5', 'request_id': 'req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.658235 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] The token cache is being invalidate because project fc39540e3c13425797fca427caf460a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:26.658571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.659309 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-473b8231-2fcc-45d1-a20d-eeb6ee47ba48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:26.661799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1322/2640] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:26 2022] DELETE /identity/v3/projects/fc39540e3c13425797fca427caf460a5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:26.666152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778a68-603d-48e7-9b3a-4ae939131e99 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:26.666750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778a68-603d-48e7-9b3a-4ae939131e99 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:26.667198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16778a68-603d-48e7-9b3a-4ae939131e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:26.692163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-16778a68-603d-48e7-9b3a-4ae939131e99 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:26.693718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-16778a68-603d-48e7-9b3a-4ae939131e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:26.767592 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1319/2641] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:44:26.775815 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90b62-9572-434d-91f6-6b1775e6bcaf None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:26.775996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90b62-9572-434d-91f6-6b1775e6bcaf None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:26.776275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90b62-9572-434d-91f6-6b1775e6bcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:26.808313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6ce90b62-9572-434d-91f6-6b1775e6bcaf None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:26.809664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6ce90b62-9572-434d-91f6-6b1775e6bcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:26.819884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1323/2642] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:26.824839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16778a68-603d-48e7-9b3a-4ae939131e99 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:26.835833 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16778a68-603d-48e7-9b3a-4ae939131e99 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:26.852019 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:26.852684 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:26.852966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:26.853242 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:26.854232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:44:26.854232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:26.855854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:26.874477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1320/2643] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:44:26.876276 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce90b62-9572-434d-91f6-6b1775e6bcaf None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:26.887030 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce90b62-9572-434d-91f6-6b1775e6bcaf None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:26.893823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a346438-b5ad-4673-9485-fecef7e494a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:26.894772 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346438-b5ad-4673-9485-fecef7e494a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:26.895046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346438-b5ad-4673-9485-fecef7e494a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:26.895570 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a346438-b5ad-4673-9485-fecef7e494a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:26.896367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a346438-b5ad-4673-9485-fecef7e494a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:26.898937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a346438-b5ad-4673-9485-fecef7e494a2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:26.936806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1324/2644] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:26 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:26.941966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:26.955784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78c8d20-79f7-45ed-8a56-064b67f092d5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:27.014444 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:27.031007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e07bd-d6bf-423e-b659-81f1459e1648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:27.031622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e07bd-d6bf-423e-b659-81f1459e1648 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:27.031922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e07bd-d6bf-423e-b659-81f1459e1648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:27.032193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e07bd-d6bf-423e-b659-81f1459e1648 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:27.032834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e07bd-d6bf-423e-b659-81f1459e1648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:27.034815 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e07bd-d6bf-423e-b659-81f1459e1648 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:27.058946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1321/2645] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:26 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:27.063630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a346438-b5ad-4673-9485-fecef7e494a2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:27.074798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a346438-b5ad-4673-9485-fecef7e494a2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:27.079331 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801795f-e67b-41a0-9cb9-08d938373739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:27.079930 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801795f-e67b-41a0-9cb9-08d938373739 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:27.080206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801795f-e67b-41a0-9cb9-08d938373739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:27.080474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801795f-e67b-41a0-9cb9-08d938373739 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:27.081226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801795f-e67b-41a0-9cb9-08d938373739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:27.082856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801795f-e67b-41a0-9cb9-08d938373739 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:27.084260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:27.097638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1325/2646] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:27.099249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e07bd-d6bf-423e-b659-81f1459e1648 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:27.109331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e07bd-d6bf-423e-b659-81f1459e1648 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:27.114034 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b311277-5179-4bc1-8d39-7883cd08e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:27.114669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311277-5179-4bc1-8d39-7883cd08e4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:27.114966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311277-5179-4bc1-8d39-7883cd08e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:27.115216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b311277-5179-4bc1-8d39-7883cd08e4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:27.116033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311277-5179-4bc1-8d39-7883cd08e4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:27.117641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b311277-5179-4bc1-8d39-7883cd08e4e5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:27.128425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1322/2647] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:27.132746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801795f-e67b-41a0-9cb9-08d938373739 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:27.143269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801795f-e67b-41a0-9cb9-08d938373739 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:27.148094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:27.148780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:27.149056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:27.149348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] PATH_INFO: `/v3/projects/c2668f897b304861a96ed2a671ec857b/users/b93a56601a324423ac9d98cb9fed3faa/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:27.164228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2668f897b304861a96ed2a671ec857b, user_id=b93a56601a324423ac9d98cb9fed3faa, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:27.166935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:27.180632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1326/2648] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:27 2022] PUT /identity/v3/projects/c2668f897b304861a96ed2a671ec857b/users/b93a56601a324423ac9d98cb9fed3faa/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:27.191061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f53d-9c5e-4f03-868b-526ddaef3860 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:27.191370 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f53d-9c5e-4f03-868b-526ddaef3860 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:27.191681 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f53d-9c5e-4f03-868b-526ddaef3860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:27.220934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-17e2f53d-9c5e-4f03-868b-526ddaef3860 None None] MFA Rules not processed for user `b93a56601a324423ac9d98cb9fed3faa`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:27.222191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-17e2f53d-9c5e-4f03-868b-526ddaef3860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:27.302816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1323/2649] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:27.311172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:27.312925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:27.394651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc717fd-1e4b-404b-bee6-d1436bd9e544 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:27.400528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46577c7-1afd-4a33-b373-d642b51081e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:27.401165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46577c7-1afd-4a33-b373-d642b51081e4 service nova] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:27.401441 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46577c7-1afd-4a33-b373-d642b51081e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:27.401713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46577c7-1afd-4a33-b373-d642b51081e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:27.410304 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46577c7-1afd-4a33-b373-d642b51081e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:27.411982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46577c7-1afd-4a33-b373-d642b51081e4 service nova] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:27.422303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1327/2650] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:27.542621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb75d-1dfd-4bce-9a7c-01d078bbd544 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:27.543205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb75d-1dfd-4bce-9a7c-01d078bbd544 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:27.543483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fb75d-1dfd-4bce-9a7c-01d078bbd544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:27.566893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1d9fb75d-1dfd-4bce-9a7c-01d078bbd544 None None] MFA Rules not processed for user `844e860b3c6a40ff9ae1c59b61a27d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:27.568321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1d9fb75d-1dfd-4bce-9a7c-01d078bbd544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:27.634448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1324/2651] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:32.799802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46577c7-1afd-4a33-b373-d642b51081e4 service nova] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:32.862838 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46577c7-1afd-4a33-b373-d642b51081e4 service nova] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:32.867270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:32.867927 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:32.868206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:32.868479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] PATH_INFO: `/v3/users/b93a56601a324423ac9d98cb9fed3faa` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:32.869558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b93a56601a324423ac9d98cb9fed3faa)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:32.871501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:32.921425 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b93a56601a324423ac9d98cb9fed3faa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:32.922092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b93a56601a324423ac9d98cb9fed3faa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:32.930487 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b93a56601a324423ac9d98cb9fed3faa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:32.935312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:32.945104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b93a56601a324423ac9d98cb9fed3faa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:32.945790 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b93a56601a324423ac9d98cb9fed3faa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:32.962126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1328/2652] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:32 2022] DELETE /identity/v3/users/b93a56601a324423ac9d98cb9fed3faa => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:32.966842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f602-2d36-468b-9183-141493a7a8e3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:32.967375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f602-2d36-468b-9183-141493a7a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:32.967375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e53f602-2d36-468b-9183-141493a7a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:32.987589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-6e53f602-2d36-468b-9183-141493a7a8e3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:32.988974 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6e53f602-2d36-468b-9183-141493a7a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:33.043639 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:33.054180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1325/2653] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:33.063569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:33.064988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:33.140492 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd8dfd-6291-4709-ac30-a96e03f400cf admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:33.144101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0695d8fa-e999-4b06-a892-f5797fe9786d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:33.144705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695d8fa-e999-4b06-a892-f5797fe9786d service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:33.144988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695d8fa-e999-4b06-a892-f5797fe9786d service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:33.145251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0695d8fa-e999-4b06-a892-f5797fe9786d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:33.163916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695d8fa-e999-4b06-a892-f5797fe9786d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:33.166456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0695d8fa-e999-4b06-a892-f5797fe9786d service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:33.177538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1329/2654] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:33.615745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53f602-2d36-468b-9183-141493a7a8e3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:33.617501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6e53f602-2d36-468b-9183-141493a7a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:33.649467 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e53f602-2d36-468b-9183-141493a7a8e3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:33.654959 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:33.655610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:33.655888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:33.656152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] PATH_INFO: `/v3/projects/c2668f897b304861a96ed2a671ec857b` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:33.658713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2668f897b304861a96ed2a671ec857b)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:33.659864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:33.711347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2668f897b304861a96ed2a671ec857b', 'request_id': 'req-ef1bac3a-7211-4a61-9ffe-806d704e66b8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:33.717736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2668f897b304861a96ed2a671ec857b', 'request_id': 'req-ef1bac3a-7211-4a61-9ffe-806d704e66b8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:33.726181 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2668f897b304861a96ed2a671ec857b', 'request_id': 'req-ef1bac3a-7211-4a61-9ffe-806d704e66b8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:33.742302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] The token cache is being invalidate because project c2668f897b304861a96ed2a671ec857b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:33.742665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:33.743339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ef1bac3a-7211-4a61-9ffe-806d704e66b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:33.744933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1326/2655] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:33 2022] DELETE /identity/v3/projects/c2668f897b304861a96ed2a671ec857b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:33.750022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d706-482a-4ded-aee7-d7f88777f4d0 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:33.750307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d706-482a-4ded-aee7-d7f88777f4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:33.750576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716d706-482a-4ded-aee7-d7f88777f4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:33.770846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b716d706-482a-4ded-aee7-d7f88777f4d0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:33.772141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b716d706-482a-4ded-aee7-d7f88777f4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:33.832334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1330/2656] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:44:33.840336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886924-9727-4d16-846c-158a026efac2 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:33.840617 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886924-9727-4d16-846c-158a026efac2 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:33.840885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4886924-9727-4d16-846c-158a026efac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:33.861657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c4886924-9727-4d16-846c-158a026efac2 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:33.862938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c4886924-9727-4d16-846c-158a026efac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:33.871086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1327/2657] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:33.875226 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716d706-482a-4ded-aee7-d7f88777f4d0 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:33.885628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716d706-482a-4ded-aee7-d7f88777f4d0 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:33.890794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:33.891554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:33.891956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:33.892294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:33.893111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:44:33.893474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:33.895199 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:33.907340 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1331/2658] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:44:33.912324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4886924-9727-4d16-846c-158a026efac2 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:33.921943 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4886924-9727-4d16-846c-158a026efac2 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:33.928471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94727686-faae-4ae2-8c2d-0a8a1a95ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:33.929289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94727686-faae-4ae2-8c2d-0a8a1a95ef55 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:33.929805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94727686-faae-4ae2-8c2d-0a8a1a95ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:33.930116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94727686-faae-4ae2-8c2d-0a8a1a95ef55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:33.930846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94727686-faae-4ae2-8c2d-0a8a1a95ef55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:33.933268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94727686-faae-4ae2-8c2d-0a8a1a95ef55 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:33.963586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1328/2659] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:33 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:33.967840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:33.978252 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e77e6e8-a00c-41b8-8673-98f484527563 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:34.041375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ec98-d6bf-43ed-aff8-d98da269fee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:34.042198 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ec98-d6bf-43ed-aff8-d98da269fee4 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.042544 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ec98-d6bf-43ed-aff8-d98da269fee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.042904 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6325ec98-d6bf-43ed-aff8-d98da269fee4 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.043607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325ec98-d6bf-43ed-aff8-d98da269fee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:34.045614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6325ec98-d6bf-43ed-aff8-d98da269fee4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:34.057621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:34.071348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1332/2660] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:33 2022] POST /identity/v3/users => generated 287 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:44:34.075479 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94727686-faae-4ae2-8c2d-0a8a1a95ef55 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:34.086454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94727686-faae-4ae2-8c2d-0a8a1a95ef55 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:34.091031 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46289524-234e-4dd9-9bf7-532834e4b0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:34.091647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289524-234e-4dd9-9bf7-532834e4b0df admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.091922 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289524-234e-4dd9-9bf7-532834e4b0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.092189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46289524-234e-4dd9-9bf7-532834e4b0df admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.092870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46289524-234e-4dd9-9bf7-532834e4b0df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:34.094510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46289524-234e-4dd9-9bf7-532834e4b0df admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:34.108099 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1329/2661] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:34.112318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ec98-d6bf-43ed-aff8-d98da269fee4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:34.122804 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6325ec98-d6bf-43ed-aff8-d98da269fee4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:34.127996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585228ce-c57e-4b96-8363-ab42590cc2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:34.128595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585228ce-c57e-4b96-8363-ab42590cc2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.128881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585228ce-c57e-4b96-8363-ab42590cc2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.129156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585228ce-c57e-4b96-8363-ab42590cc2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.129826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585228ce-c57e-4b96-8363-ab42590cc2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:34.131465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585228ce-c57e-4b96-8363-ab42590cc2d8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:34.143195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1333/2662] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:34.148711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46289524-234e-4dd9-9bf7-532834e4b0df admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:34.159125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46289524-234e-4dd9-9bf7-532834e4b0df admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:34.164816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:34.165478 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.165783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.166054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] PATH_INFO: `/v3/projects/f7662cfbb4954d338f4f712d3fb4f43e/users/f3873255acff492fbb522850a57c02fa/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.182933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7662cfbb4954d338f4f712d3fb4f43e, user_id=f3873255acff492fbb522850a57c02fa, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:34.185609 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:34.199703 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1330/2663] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:34 2022] PUT /identity/v3/projects/f7662cfbb4954d338f4f712d3fb4f43e/users/f3873255acff492fbb522850a57c02fa/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:34.210694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967f18a-adc4-4f33-82b6-db16c52722f5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.210984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967f18a-adc4-4f33-82b6-db16c52722f5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.211255 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2967f18a-adc4-4f33-82b6-db16c52722f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.239406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-2967f18a-adc4-4f33-82b6-db16c52722f5 None None] MFA Rules not processed for user `f3873255acff492fbb522850a57c02fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:34.240704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-2967f18a-adc4-4f33-82b6-db16c52722f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:34.306881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1334/2664] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:34.318173 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:34.320103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:34.393510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9423-f301-4ffb-8bbd-07b587717324 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:34.399725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42d795-6f6d-42cb-a778-776ed2ca35b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:34.400347 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d795-6f6d-42cb-a778-776ed2ca35b0 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.400603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d795-6f6d-42cb-a778-776ed2ca35b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.400893 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42d795-6f6d-42cb-a778-776ed2ca35b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.409602 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42d795-6f6d-42cb-a778-776ed2ca35b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:34.411230 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42d795-6f6d-42cb-a778-776ed2ca35b0 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:34.420180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1331/2665] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:34.626228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967f18a-adc4-4f33-82b6-db16c52722f5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:34.689594 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2967f18a-adc4-4f33-82b6-db16c52722f5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:34.694949 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:34.695587 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.695867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.696131 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] PATH_INFO: `/v3/users/f3873255acff492fbb522850a57c02fa` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.697388 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3873255acff492fbb522850a57c02fa)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:34.699373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:34.753086 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3873255acff492fbb522850a57c02fa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:34.753769 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3873255acff492fbb522850a57c02fa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:34.762085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3873255acff492fbb522850a57c02fa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:34.775067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3873255acff492fbb522850a57c02fa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:34.775848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3873255acff492fbb522850a57c02fa'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:34.781566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:34.792663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1335/2666] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:34 2022] DELETE /identity/v3/users/f3873255acff492fbb522850a57c02fa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:34.797256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bce5-0579-440b-9129-11e90d6dc34c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.797536 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bce5-0579-440b-9129-11e90d6dc34c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.797837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7bce5-0579-440b-9129-11e90d6dc34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.806919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:34.822131 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-b6f7bce5-0579-440b-9129-11e90d6dc34c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:34.823564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b6f7bce5-0579-440b-9129-11e90d6dc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:34.891537 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1332/2667] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:34.902047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:34.903475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:34.963651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ef29e-3baa-44bf-bf3e-39ab9047192f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:34.967628 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42a896-49d1-4150-afda-a89ff5949441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:34.968231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a896-49d1-4150-afda-a89ff5949441 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:34.968504 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a896-49d1-4150-afda-a89ff5949441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:34.968803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a896-49d1-4150-afda-a89ff5949441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:34.978621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42a896-49d1-4150-afda-a89ff5949441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:34.980072 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42a896-49d1-4150-afda-a89ff5949441 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:34.990334 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1336/2668] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:35.292197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7bce5-0579-440b-9129-11e90d6dc34c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:35.293827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-b6f7bce5-0579-440b-9129-11e90d6dc34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:35.310011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7bce5-0579-440b-9129-11e90d6dc34c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:35.320004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:35.320699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.320969 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.321236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] PATH_INFO: `/v3/projects/f7662cfbb4954d338f4f712d3fb4f43e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.322682 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7662cfbb4954d338f4f712d3fb4f43e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:35.324993 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:35.401146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7662cfbb4954d338f4f712d3fb4f43e', 'request_id': 'req-73f3f674-41c5-47cd-8eb5-40ae09006743'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:35.409784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7662cfbb4954d338f4f712d3fb4f43e', 'request_id': 'req-73f3f674-41c5-47cd-8eb5-40ae09006743'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:35.428729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7662cfbb4954d338f4f712d3fb4f43e', 'request_id': 'req-73f3f674-41c5-47cd-8eb5-40ae09006743'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:35.449104 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] The token cache is being invalidate because project f7662cfbb4954d338f4f712d3fb4f43e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:35.450059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:35.451524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-73f3f674-41c5-47cd-8eb5-40ae09006743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:35.460068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88812-8ec3-42a8-b01a-de20af458256 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.460634 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88812-8ec3-42a8-b01a-de20af458256 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.461397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88812-8ec3-42a8-b01a-de20af458256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.464425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1333/2669] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:35 2022] DELETE /identity/v3/projects/f7662cfbb4954d338f4f712d3fb4f43e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:35.492015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-c2d88812-8ec3-42a8-b01a-de20af458256 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:35.493273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c2d88812-8ec3-42a8-b01a-de20af458256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:35.558540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1337/2670] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:35.567826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bde8c2-09b9-4ed6-bb42-b2dde39e2fe4 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.568112 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bde8c2-09b9-4ed6-bb42-b2dde39e2fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.568389 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bde8c2-09b9-4ed6-bb42-b2dde39e2fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.587929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-67bde8c2-09b9-4ed6-bb42-b2dde39e2fe4 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:35.589156 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-67bde8c2-09b9-4ed6-bb42-b2dde39e2fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:35.597265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1334/2671] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:35.601514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d88812-8ec3-42a8-b01a-de20af458256 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:35.611669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d88812-8ec3-42a8-b01a-de20af458256 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:35.616381 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:35.616982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.617263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.617529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.618214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:44:35.618542 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:35.620156 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:35.632571 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1338/2672] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:44:35.637600 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bde8c2-09b9-4ed6-bb42-b2dde39e2fe4 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:35.647417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bde8c2-09b9-4ed6-bb42-b2dde39e2fe4 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:35.652055 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2cb83-bb4b-46ec-aabf-fb71be663c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:35.652662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2cb83-bb4b-46ec-aabf-fb71be663c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.652936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2cb83-bb4b-46ec-aabf-fb71be663c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.653205 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2cb83-bb4b-46ec-aabf-fb71be663c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.653873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2cb83-bb4b-46ec-aabf-fb71be663c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:35.655783 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2cb83-bb4b-46ec-aabf-fb71be663c8c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:35.684748 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1335/2673] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:35 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:35.689037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:35.699291 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4c84ef-037d-4c3c-8127-c54fe7905bd7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:35.762631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4cac-b217-47eb-9b57-0fb397cd5415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:35.763472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4cac-b217-47eb-9b57-0fb397cd5415 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.763846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4cac-b217-47eb-9b57-0fb397cd5415 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.764208 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4cac-b217-47eb-9b57-0fb397cd5415 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.765157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4cac-b217-47eb-9b57-0fb397cd5415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:35.767215 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4cac-b217-47eb-9b57-0fb397cd5415 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:35.792674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1339/2674] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:35 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:35.796966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2cb83-bb4b-46ec-aabf-fb71be663c8c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:35.807551 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2cb83-bb4b-46ec-aabf-fb71be663c8c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:35.812424 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb3870-2de2-4964-9a90-da0da2c16e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:35.813056 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3870-2de2-4964-9a90-da0da2c16e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.813336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3870-2de2-4964-9a90-da0da2c16e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.813605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fb3870-2de2-4964-9a90-da0da2c16e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.814305 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb3870-2de2-4964-9a90-da0da2c16e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:35.816109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fb3870-2de2-4964-9a90-da0da2c16e23 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:35.827934 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1336/2675] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:35.832118 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4cac-b217-47eb-9b57-0fb397cd5415 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:35.843563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4cac-b217-47eb-9b57-0fb397cd5415 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:35.849713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c745a05-428e-4567-8755-dba17c3fcf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:35.850377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c745a05-428e-4567-8755-dba17c3fcf94 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.850659 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c745a05-428e-4567-8755-dba17c3fcf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.850912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c745a05-428e-4567-8755-dba17c3fcf94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.851579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c745a05-428e-4567-8755-dba17c3fcf94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:35.853260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c745a05-428e-4567-8755-dba17c3fcf94 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:35.865826 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1340/2676] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:35.870185 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb3870-2de2-4964-9a90-da0da2c16e23 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:35.881123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fb3870-2de2-4964-9a90-da0da2c16e23 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:35.888067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a9b20-3f83-422b-8dc6-454636fb9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:35.888870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9b20-3f83-422b-8dc6-454636fb9b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.889163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9b20-3f83-422b-8dc6-454636fb9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.889443 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a9b20-3f83-422b-8dc6-454636fb9b90 admin admin] PATH_INFO: `/v3/projects/89404d3ba23746b9b01bd9d150eba25d/users/246dbcbba2ba4d3a816f3c03a7177964/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.906022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a9b20-3f83-422b-8dc6-454636fb9b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89404d3ba23746b9b01bd9d150eba25d, user_id=246dbcbba2ba4d3a816f3c03a7177964, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:35.908722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a9b20-3f83-422b-8dc6-454636fb9b90 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:35.925706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1337/2677] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:35 2022] PUT /identity/v3/projects/89404d3ba23746b9b01bd9d150eba25d/users/246dbcbba2ba4d3a816f3c03a7177964/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:35.936843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef5d4-5521-4960-9b75-a7ee226ada50 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:35.937380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef5d4-5521-4960-9b75-a7ee226ada50 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:35.937524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ef5d4-5521-4960-9b75-a7ee226ada50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:35.945136 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:35.968326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-d18ef5d4-5521-4960-9b75-a7ee226ada50 None None] MFA Rules not processed for user `246dbcbba2ba4d3a816f3c03a7177964`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:35.969564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d18ef5d4-5521-4960-9b75-a7ee226ada50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:36.040832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1341/2678] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:36.045504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a9b20-3f83-422b-8dc6-454636fb9b90 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:36.073784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:36.116798 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a9b20-3f83-422b-8dc6-454636fb9b90 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:36.123025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e25bd1-848b-47be-925e-ea61e362635c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:36.123636 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e25bd1-848b-47be-925e-ea61e362635c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:36.124046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e25bd1-848b-47be-925e-ea61e362635c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:36.124247 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e25bd1-848b-47be-925e-ea61e362635c admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:36.124882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e25bd1-848b-47be-925e-ea61e362635c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:36.126924 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e25bd1-848b-47be-925e-ea61e362635c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:36.155707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1338/2679] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:36 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:36.160083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ef5d4-5521-4960-9b75-a7ee226ada50 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:36.171216 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ef5d4-5521-4960-9b75-a7ee226ada50 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:36.229703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1c202-a59f-465d-b806-9dd9d68f77e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:36.230355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c202-a59f-465d-b806-9dd9d68f77e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:36.230640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c202-a59f-465d-b806-9dd9d68f77e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:36.230913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1c202-a59f-465d-b806-9dd9d68f77e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:36.231551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1c202-a59f-465d-b806-9dd9d68f77e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:36.233508 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1c202-a59f-465d-b806-9dd9d68f77e8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:36.259738 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1342/2680] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:36 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:36.260981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e25bd1-848b-47be-925e-ea61e362635c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:36.271910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e25bd1-848b-47be-925e-ea61e362635c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:36.277731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a63a9b-bfb7-4ddf-984b-f76773b36bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:36.278365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a63a9b-bfb7-4ddf-984b-f76773b36bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:36.278658 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a63a9b-bfb7-4ddf-984b-f76773b36bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:36.278928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a63a9b-bfb7-4ddf-984b-f76773b36bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:36.279584 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a63a9b-bfb7-4ddf-984b-f76773b36bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:36.281225 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a63a9b-bfb7-4ddf-984b-f76773b36bc5 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:36.295734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1339/2681] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:36.296842 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1c202-a59f-465d-b806-9dd9d68f77e8 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:36.306889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1c202-a59f-465d-b806-9dd9d68f77e8 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:36.311708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f997f-7824-43be-a424-aee49203f48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:36.312361 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f997f-7824-43be-a424-aee49203f48d admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:36.312631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f997f-7824-43be-a424-aee49203f48d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:36.312898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f997f-7824-43be-a424-aee49203f48d admin admin] PATH_INFO: `/v3/projects/6a8eacc1dca94e02a10cf7edf69b2dae/users/a181e9cdd286494c9272c7431f31be1e/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:36.328787 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f997f-7824-43be-a424-aee49203f48d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8eacc1dca94e02a10cf7edf69b2dae, user_id=a181e9cdd286494c9272c7431f31be1e, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:36.331957 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f997f-7824-43be-a424-aee49203f48d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:36.346618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1343/2682] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:36 2022] PUT /identity/v3/projects/6a8eacc1dca94e02a10cf7edf69b2dae/users/a181e9cdd286494c9272c7431f31be1e/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:36.350846 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a63a9b-bfb7-4ddf-984b-f76773b36bc5 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:36.362061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a63a9b-bfb7-4ddf-984b-f76773b36bc5 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:36.428590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07955a92-69e5-4085-a5fb-9f90bf2ec5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:36.429207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07955a92-69e5-4085-a5fb-9f90bf2ec5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:36.429488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07955a92-69e5-4085-a5fb-9f90bf2ec5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:36.429780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07955a92-69e5-4085-a5fb-9f90bf2ec5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:36.430428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07955a92-69e5-4085-a5fb-9f90bf2ec5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:36.432027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07955a92-69e5-4085-a5fb-9f90bf2ec5d0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:36.442430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1340/2683] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:44:36.446754 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f997f-7824-43be-a424-aee49203f48d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:36.457179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f997f-7824-43be-a424-aee49203f48d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:36.462154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:36.462809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:36.463120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:36.463371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] PATH_INFO: `/v3/projects/6a8eacc1dca94e02a10cf7edf69b2dae/users/a181e9cdd286494c9272c7431f31be1e/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:36.465363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8eacc1dca94e02a10cf7edf69b2dae, user_id=a181e9cdd286494c9272c7431f31be1e, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:36.468036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:36.479135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1344/2684] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:36 2022] PUT /identity/v3/projects/6a8eacc1dca94e02a10cf7edf69b2dae/users/a181e9cdd286494c9272c7431f31be1e/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:36.489714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb94a-4c40-493c-9639-15366ad762e7 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:36.490025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb94a-4c40-493c-9639-15366ad762e7 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:36.490297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabb94a-4c40-493c-9639-15366ad762e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:36.519501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-0cabb94a-4c40-493c-9639-15366ad762e7 None None] MFA Rules not processed for user `a181e9cdd286494c9272c7431f31be1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:36.520729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0cabb94a-4c40-493c-9639-15366ad762e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:36.599750 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1341/2685] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:36.610782 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:36.613794 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:36.662341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:36.675101 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535df90-55c4-49d5-af35-484579669636 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:36.678920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d1899-84fe-48dc-90e2-d1b9a30b00c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:36.679539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d1899-84fe-48dc-90e2-d1b9a30b00c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:36.679813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d1899-84fe-48dc-90e2-d1b9a30b00c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:36.680082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d1899-84fe-48dc-90e2-d1b9a30b00c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:36.689773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d1899-84fe-48dc-90e2-d1b9a30b00c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:36.691228 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d1899-84fe-48dc-90e2-d1b9a30b00c4 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:36.701060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1345/2686] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:37.186207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabb94a-4c40-493c-9639-15366ad762e7 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:37.208206 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:37.266314 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabb94a-4c40-493c-9639-15366ad762e7 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:37.271203 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:37.271897 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:37.272562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:37.272562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] PATH_INFO: `/v3/users/246dbcbba2ba4d3a816f3c03a7177964` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:37.273562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] RBAC: Authorizing `identity:delete_user(user_id=246dbcbba2ba4d3a816f3c03a7177964)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:37.275543 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:37.327908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246dbcbba2ba4d3a816f3c03a7177964'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:37.328996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246dbcbba2ba4d3a816f3c03a7177964'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:37.340124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246dbcbba2ba4d3a816f3c03a7177964'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:37.347838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246dbcbba2ba4d3a816f3c03a7177964'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:37.348569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246dbcbba2ba4d3a816f3c03a7177964'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:37.371672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1342/2687] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:37 2022] DELETE /identity/v3/users/246dbcbba2ba4d3a816f3c03a7177964 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:37.376033 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb451ce-d802-4272-93f6-c1586592617d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:37.376547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb451ce-d802-4272-93f6-c1586592617d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:37.376648 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb451ce-d802-4272-93f6-c1586592617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:37.396684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ceb451ce-d802-4272-93f6-c1586592617d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:37.397935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ceb451ce-d802-4272-93f6-c1586592617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:37.470434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1346/2688] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:37.480986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:37.483154 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:37.561281 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ceaec-5cb9-4df4-9395-27bc89a8d48f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:37.565716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd958ca-081a-490d-b6c0-7a2b132974ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:37.566516 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd958ca-081a-490d-b6c0-7a2b132974ec service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:37.566863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd958ca-081a-490d-b6c0-7a2b132974ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:37.567200 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd958ca-081a-490d-b6c0-7a2b132974ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:37.578412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd958ca-081a-490d-b6c0-7a2b132974ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:37.579994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd958ca-081a-490d-b6c0-7a2b132974ec service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:37.593364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1343/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:37.953832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb451ce-d802-4272-93f6-c1586592617d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:37.956032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ceb451ce-d802-4272-93f6-c1586592617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:37.998052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb451ce-d802-4272-93f6-c1586592617d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:38.003251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:38.003864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:38.004220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:38.004548 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] PATH_INFO: `/v3/projects/89404d3ba23746b9b01bd9d150eba25d` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:38.006480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] RBAC: Authorizing `identity:delete_project(project_id=89404d3ba23746b9b01bd9d150eba25d)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:38.009286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:38.061795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89404d3ba23746b9b01bd9d150eba25d', 'request_id': 'req-67da49ac-6016-4f4d-b340-a82054ee8ecb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.068143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89404d3ba23746b9b01bd9d150eba25d', 'request_id': 'req-67da49ac-6016-4f4d-b340-a82054ee8ecb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.075890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89404d3ba23746b9b01bd9d150eba25d', 'request_id': 'req-67da49ac-6016-4f4d-b340-a82054ee8ecb'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.087322 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] The token cache is being invalidate because project 89404d3ba23746b9b01bd9d150eba25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:38.087614 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.088293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.089872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1347/2690] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:37 2022] DELETE /identity/v3/projects/89404d3ba23746b9b01bd9d150eba25d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:38.093810 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd958ca-081a-490d-b6c0-7a2b132974ec service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:38.103812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd958ca-081a-490d-b6c0-7a2b132974ec service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:38.146092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:38.164521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:38.165168 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:38.165448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:38.165903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] PATH_INFO: `/v3/users/a181e9cdd286494c9272c7431f31be1e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:38.167139 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a181e9cdd286494c9272c7431f31be1e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:38.169084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:38.218665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a181e9cdd286494c9272c7431f31be1e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.219319 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a181e9cdd286494c9272c7431f31be1e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.228251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a181e9cdd286494c9272c7431f31be1e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.236611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a181e9cdd286494c9272c7431f31be1e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.237340 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-9b3d950c-3b55-44c9-86f6-41e9e6d58e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a181e9cdd286494c9272c7431f31be1e'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.254624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1344/2691] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:38 2022] DELETE /identity/v3/users/a181e9cdd286494c9272c7431f31be1e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:38.523767 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:38.525921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:38.539586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da49ac-6016-4f4d-b340-a82054ee8ecb admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:38.599882 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:38.600476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:38.600751 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:38.601016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] PATH_INFO: `/v3/projects/6a8eacc1dca94e02a10cf7edf69b2dae` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:38.602148 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8eacc1dca94e02a10cf7edf69b2dae)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:38.604048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:38.615392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:38.651316 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8eacc1dca94e02a10cf7edf69b2dae', 'request_id': 'req-acb1fc9a-fabe-4abb-878f-60527d99db4c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.657484 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8eacc1dca94e02a10cf7edf69b2dae', 'request_id': 'req-acb1fc9a-fabe-4abb-878f-60527d99db4c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.666515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8eacc1dca94e02a10cf7edf69b2dae', 'request_id': 'req-acb1fc9a-fabe-4abb-878f-60527d99db4c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.676955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] The token cache is being invalidate because project 6a8eacc1dca94e02a10cf7edf69b2dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:38.677317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.678003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-acb1fc9a-fabe-4abb-878f-60527d99db4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:38.679497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1348/2692] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:38 2022] DELETE /identity/v3/projects/6a8eacc1dca94e02a10cf7edf69b2dae => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:38.684512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ae79-e349-42a5-ba75-06d74cfeee67 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:38.685002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ae79-e349-42a5-ba75-06d74cfeee67 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:38.685121 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ae79-e349-42a5-ba75-06d74cfeee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:38.706709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-d452ae79-e349-42a5-ba75-06d74cfeee67 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:38.707914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d452ae79-e349-42a5-ba75-06d74cfeee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:38.771811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1345/2693] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:38.781450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dc178-2f78-4269-b854-54e156fc7fcc None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:38.781733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dc178-2f78-4269-b854-54e156fc7fcc None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:38.782041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3dc178-2f78-4269-b854-54e156fc7fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:38.804852 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0d3dc178-2f78-4269-b854-54e156fc7fcc None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:38.806119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0d3dc178-2f78-4269-b854-54e156fc7fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:38.814716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1349/2694] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:38.819249 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ae79-e349-42a5-ba75-06d74cfeee67 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:38.829690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ae79-e349-42a5-ba75-06d74cfeee67 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:38.834509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:38.835113 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:38.835391 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:38.835660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:38.836303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:44:38.836604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:38.838282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:38.850364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1346/2695] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:44:38.856332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dc178-2f78-4269-b854-54e156fc7fcc None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:38.865773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3dc178-2f78-4269-b854-54e156fc7fcc None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:38.871179 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a352-6a1f-4860-8f90-f290ce6f27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:38.871774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a352-6a1f-4860-8f90-f290ce6f27a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:38.872052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a352-6a1f-4860-8f90-f290ce6f27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:38.872317 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a352-6a1f-4860-8f90-f290ce6f27a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:38.872963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a352-6a1f-4860-8f90-f290ce6f27a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:38.874923 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a352-6a1f-4860-8f90-f290ce6f27a5 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:38.903941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1350/2696] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:38 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:38.908148 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:38.918109 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25e3837-a7ed-4cdb-a5c9-aa269f8aa4ba admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:38.969291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:38.987775 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d76e9-59f6-4a50-9b1d-4285ef8c9a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:38.988820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d76e9-59f6-4a50-9b1d-4285ef8c9a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:38.988820 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d76e9-59f6-4a50-9b1d-4285ef8c9a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:38.989179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71d76e9-59f6-4a50-9b1d-4285ef8c9a7e admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:38.989554 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d76e9-59f6-4a50-9b1d-4285ef8c9a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:38.991553 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71d76e9-59f6-4a50-9b1d-4285ef8c9a7e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.013241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1347/2697] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:38 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:39.017500 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a352-6a1f-4860-8f90-f290ce6f27a5 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.027688 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a352-6a1f-4860-8f90-f290ce6f27a5 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.032663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dde4d-508f-4d9d-8e66-ec2f21cac307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.033329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dde4d-508f-4d9d-8e66-ec2f21cac307 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.033721 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dde4d-508f-4d9d-8e66-ec2f21cac307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.034087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992dde4d-508f-4d9d-8e66-ec2f21cac307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.034518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dde4d-508f-4d9d-8e66-ec2f21cac307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.036153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992dde4d-508f-4d9d-8e66-ec2f21cac307 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.046372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1351/2698] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:39.050446 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d76e9-59f6-4a50-9b1d-4285ef8c9a7e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.061024 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71d76e9-59f6-4a50-9b1d-4285ef8c9a7e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.065727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e53a7-4d07-488f-910e-e09ce0329f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.066378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e53a7-4d07-488f-910e-e09ce0329f33 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.066659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e53a7-4d07-488f-910e-e09ce0329f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.066928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e53a7-4d07-488f-910e-e09ce0329f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.067716 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e53a7-4d07-488f-910e-e09ce0329f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.069327 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e53a7-4d07-488f-910e-e09ce0329f33 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.080827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1348/2699] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:39.084927 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dde4d-508f-4d9d-8e66-ec2f21cac307 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.096015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992dde4d-508f-4d9d-8e66-ec2f21cac307 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.101283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e741b3-b1e7-40eb-a63d-791d25cae377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.101921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e741b3-b1e7-40eb-a63d-791d25cae377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.102227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e741b3-b1e7-40eb-a63d-791d25cae377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.102497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e741b3-b1e7-40eb-a63d-791d25cae377 admin admin] PATH_INFO: `/v3/projects/59ffa0b8c7f145f992e6240dfc7297de/users/2ccdca7e0377439abc9516c10ddfd2c4/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.117141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e741b3-b1e7-40eb-a63d-791d25cae377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ffa0b8c7f145f992e6240dfc7297de, user_id=2ccdca7e0377439abc9516c10ddfd2c4, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.119819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e741b3-b1e7-40eb-a63d-791d25cae377 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.138220 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1352/2700] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:39 2022] PUT /identity/v3/projects/59ffa0b8c7f145f992e6240dfc7297de/users/2ccdca7e0377439abc9516c10ddfd2c4/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:39.148561 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55fd54-87ee-4efb-9a69-fae5b3ba63cf None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.148854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55fd54-87ee-4efb-9a69-fae5b3ba63cf None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.149125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55fd54-87ee-4efb-9a69-fae5b3ba63cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.177742 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1a55fd54-87ee-4efb-9a69-fae5b3ba63cf None None] MFA Rules not processed for user `2ccdca7e0377439abc9516c10ddfd2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:39.178989 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1a55fd54-87ee-4efb-9a69-fae5b3ba63cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:39.243428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1349/2701] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:39.249318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e741b3-b1e7-40eb-a63d-791d25cae377 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.318214 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e741b3-b1e7-40eb-a63d-791d25cae377 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.324505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800ff64-c01a-4b93-8a19-55215bb18640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.325196 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800ff64-c01a-4b93-8a19-55215bb18640 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.325461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800ff64-c01a-4b93-8a19-55215bb18640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.325802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d800ff64-c01a-4b93-8a19-55215bb18640 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.326540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800ff64-c01a-4b93-8a19-55215bb18640 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.328499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d800ff64-c01a-4b93-8a19-55215bb18640 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.361580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1353/2702] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:39 2022] POST /identity/v3/projects => generated 377 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:39.366209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55fd54-87ee-4efb-9a69-fae5b3ba63cf None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.377367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55fd54-87ee-4efb-9a69-fae5b3ba63cf None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.449214 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46359a4b-9f50-41f7-bb5a-6ff4f892d402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.449879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359a4b-9f50-41f7-bb5a-6ff4f892d402 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.450152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359a4b-9f50-41f7-bb5a-6ff4f892d402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.450416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46359a4b-9f50-41f7-bb5a-6ff4f892d402 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.451044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46359a4b-9f50-41f7-bb5a-6ff4f892d402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.452951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46359a4b-9f50-41f7-bb5a-6ff4f892d402 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.479587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1350/2703] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:39 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:39.480780 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800ff64-c01a-4b93-8a19-55215bb18640 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.490921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d800ff64-c01a-4b93-8a19-55215bb18640 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.495407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c614-a9a4-46c8-a660-ee3eaa21a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.495996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c614-a9a4-46c8-a660-ee3eaa21a259 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.496300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c614-a9a4-46c8-a660-ee3eaa21a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.496568 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab4c614-a9a4-46c8-a660-ee3eaa21a259 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.497207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c614-a9a4-46c8-a660-ee3eaa21a259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.498960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab4c614-a9a4-46c8-a660-ee3eaa21a259 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.511862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1354/2704] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:44:39.516023 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46359a4b-9f50-41f7-bb5a-6ff4f892d402 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.526594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46359a4b-9f50-41f7-bb5a-6ff4f892d402 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.531732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e2b78-7f25-4010-acaf-22f699767d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.532420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e2b78-7f25-4010-acaf-22f699767d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.532647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e2b78-7f25-4010-acaf-22f699767d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.532915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e2b78-7f25-4010-acaf-22f699767d66 admin admin] PATH_INFO: `/v3/projects/74b51a9c3592460a883b9a1637deea42/users/cc5ec1686640438dadbc9e97995fea76/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.548092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e2b78-7f25-4010-acaf-22f699767d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b51a9c3592460a883b9a1637deea42, user_id=cc5ec1686640438dadbc9e97995fea76, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.550937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7e2b78-7f25-4010-acaf-22f699767d66 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.565665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1351/2705] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:39 2022] PUT /identity/v3/projects/74b51a9c3592460a883b9a1637deea42/users/cc5ec1686640438dadbc9e97995fea76/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:44:39.570444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c614-a9a4-46c8-a660-ee3eaa21a259 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.580545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab4c614-a9a4-46c8-a660-ee3eaa21a259 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.588597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:39.639870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ab0cd7-1976-42b0-8fd0-910333baff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.640483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0cd7-1976-42b0-8fd0-910333baff55 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.640758 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0cd7-1976-42b0-8fd0-910333baff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.641026 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ab0cd7-1976-42b0-8fd0-910333baff55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.641662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab0cd7-1976-42b0-8fd0-910333baff55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.643420 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ab0cd7-1976-42b0-8fd0-910333baff55 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.654329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1355/2706] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:39.658512 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e2b78-7f25-4010-acaf-22f699767d66 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.669513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e2b78-7f25-4010-acaf-22f699767d66 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.675175 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.675854 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.676133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.676403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] PATH_INFO: `/v3/projects/74b51a9c3592460a883b9a1637deea42/users/cc5ec1686640438dadbc9e97995fea76/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.678498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b51a9c3592460a883b9a1637deea42, user_id=cc5ec1686640438dadbc9e97995fea76, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.681164 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.691996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1352/2707] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:39 2022] PUT /identity/v3/projects/74b51a9c3592460a883b9a1637deea42/users/cc5ec1686640438dadbc9e97995fea76/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:39.702891 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1579-4255-48e3-83b5-074d73dc95ae None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.703181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1579-4255-48e3-83b5-074d73dc95ae None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.703458 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1579-4255-48e3-83b5-074d73dc95ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.733605 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-feab1579-4255-48e3-83b5-074d73dc95ae None None] MFA Rules not processed for user `cc5ec1686640438dadbc9e97995fea76`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:39.734883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-feab1579-4255-48e3-83b5-074d73dc95ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:39.805547 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1356/2708] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:44:39.816429 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:39.818278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:39.829870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:39.878162 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37732538-9aac-4cec-9445-87c7071d6951 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:39.881960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cdbf1-900f-44f3-9113-692bbfc15606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:39.882578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cdbf1-900f-44f3-9113-692bbfc15606 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:39.882856 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cdbf1-900f-44f3-9113-692bbfc15606 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:39.883128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cdbf1-900f-44f3-9113-692bbfc15606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:39.943958 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cdbf1-900f-44f3-9113-692bbfc15606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:39.945480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cdbf1-900f-44f3-9113-692bbfc15606 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:39.955542 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1353/2709] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:42.531666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1579-4255-48e3-83b5-074d73dc95ae None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:42.544595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1579-4255-48e3-83b5-074d73dc95ae None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:42.549140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:42.550044 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:42.550358 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:42.550627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:42.562560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:42.564013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:42.574303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1357/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:44.959098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fd13e-3e89-4064-a45e-4af7737a7621 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:44.959603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fd13e-3e89-4064-a45e-4af7737a7621 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:44.959713 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64fd13e-3e89-4064-a45e-4af7737a7621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:44.980637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-a64fd13e-3e89-4064-a45e-4af7737a7621 None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:44.981888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a64fd13e-3e89-4064-a45e-4af7737a7621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:45.057339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1354/2711] 10.222.0.48 () {58 vars in 1009 bytes} [Sat Sep 17 03:44:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:45.107894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:45.109325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:45.192332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e0d1f-be95-40c0-b726-ba8ecf75aefa service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:45.197516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8f5c4-c08a-4b50-9244-e6af600a2433 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:45.198218 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f5c4-c08a-4b50-9244-e6af600a2433 service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:45.198499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f5c4-c08a-4b50-9244-e6af600a2433 service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:45.198770 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8f5c4-c08a-4b50-9244-e6af600a2433 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:45.213394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f5c4-c08a-4b50-9244-e6af600a2433 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:45.215516 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f8f5c4-c08a-4b50-9244-e6af600a2433 service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:45.224609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1358/2712] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:44:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:44:55.044428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=69 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:55.221003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:55.488095 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fd13e-3e89-4064-a45e-4af7737a7621 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:55.565321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64fd13e-3e89-4064-a45e-4af7737a7621 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:55.570367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:55.571243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:55.571721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:55.572187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] PATH_INFO: `/v3/users/2ccdca7e0377439abc9516c10ddfd2c4` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:55.573365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ccdca7e0377439abc9516c10ddfd2c4)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:55.575517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:55.631419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ccdca7e0377439abc9516c10ddfd2c4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:55.632726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ccdca7e0377439abc9516c10ddfd2c4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:55.641940 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ccdca7e0377439abc9516c10ddfd2c4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:55.651097 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ccdca7e0377439abc9516c10ddfd2c4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:55.652583 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ccdca7e0377439abc9516c10ddfd2c4'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:55.675328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1355/2713] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:55 2022] DELETE /identity/v3/users/2ccdca7e0377439abc9516c10ddfd2c4 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:55.679551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822a7f-cf28-4c43-8157-3c80d0cda9a5 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:55.679839 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822a7f-cf28-4c43-8157-3c80d0cda9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:55.680111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4822a7f-cf28-4c43-8157-3c80d0cda9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:55.701997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e4822a7f-cf28-4c43-8157-3c80d0cda9a5 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:55.703562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e4822a7f-cf28-4c43-8157-3c80d0cda9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:55.787010 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1359/2714] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:55.798450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:55.801137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:55.875995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990418-d728-48e7-b231-b0a82b16ba6f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:55.880321 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953bf75-ab83-414b-8cc5-4ca38f131051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:55.881008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953bf75-ab83-414b-8cc5-4ca38f131051 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:55.881302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953bf75-ab83-414b-8cc5-4ca38f131051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:55.881712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953bf75-ab83-414b-8cc5-4ca38f131051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:55.893562 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953bf75-ab83-414b-8cc5-4ca38f131051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:55.895093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953bf75-ab83-414b-8cc5-4ca38f131051 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:55.913942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1356/2715] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:56.240128 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4822a7f-cf28-4c43-8157-3c80d0cda9a5 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:56.242183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e4822a7f-cf28-4c43-8157-3c80d0cda9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:56.267289 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4822a7f-cf28-4c43-8157-3c80d0cda9a5 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:56.272919 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:56.273556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:56.273880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:56.274149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] PATH_INFO: `/v3/projects/59ffa0b8c7f145f992e6240dfc7297de` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:56.275294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ffa0b8c7f145f992e6240dfc7297de)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:56.277287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:56.339632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ffa0b8c7f145f992e6240dfc7297de', 'request_id': 'req-544fe3ed-380e-426b-a714-6dbaf171e2e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.351287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ffa0b8c7f145f992e6240dfc7297de', 'request_id': 'req-544fe3ed-380e-426b-a714-6dbaf171e2e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.361140 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ffa0b8c7f145f992e6240dfc7297de', 'request_id': 'req-544fe3ed-380e-426b-a714-6dbaf171e2e4'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.375085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] The token cache is being invalidate because project 59ffa0b8c7f145f992e6240dfc7297de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:56.375442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.376157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.377766 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1360/2716] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:56 2022] DELETE /identity/v3/projects/59ffa0b8c7f145f992e6240dfc7297de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:56.381765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953bf75-ab83-414b-8cc5-4ca38f131051 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:56.393211 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953bf75-ab83-414b-8cc5-4ca38f131051 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:56.418647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:56.481412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:56.482012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:56.482198 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:56.482460 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] PATH_INFO: `/v3/users/cc5ec1686640438dadbc9e97995fea76` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:56.483604 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc5ec1686640438dadbc9e97995fea76)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:56.485559 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:56.542204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc5ec1686640438dadbc9e97995fea76'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.542987 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc5ec1686640438dadbc9e97995fea76'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.553135 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc5ec1686640438dadbc9e97995fea76'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.561788 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc5ec1686640438dadbc9e97995fea76'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.562575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-efad2919-e83a-482c-92bf-970d2a9bc5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc5ec1686640438dadbc9e97995fea76'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:56.583498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1357/2717] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:56 2022] DELETE /identity/v3/users/cc5ec1686640438dadbc9e97995fea76 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:44:56.884598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:56.886809 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:56.901781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fe3ed-380e-426b-a714-6dbaf171e2e4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:56.992853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:56.993678 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:56.994076 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:56.994513 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] PATH_INFO: `/v3/projects/74b51a9c3592460a883b9a1637deea42` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:56.995915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b51a9c3592460a883b9a1637deea42)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:57.000097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:57.037470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:57.058988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b51a9c3592460a883b9a1637deea42', 'request_id': 'req-d6321418-1d06-4db1-8887-ce21b231b05b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:57.065724 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b51a9c3592460a883b9a1637deea42', 'request_id': 'req-d6321418-1d06-4db1-8887-ce21b231b05b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:57.075840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b51a9c3592460a883b9a1637deea42', 'request_id': 'req-d6321418-1d06-4db1-8887-ce21b231b05b'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:57.087715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] The token cache is being invalidate because project 74b51a9c3592460a883b9a1637deea42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:57.088005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:57.088711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d6321418-1d06-4db1-8887-ce21b231b05b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:57.090465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1361/2718] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:56 2022] DELETE /identity/v3/projects/74b51a9c3592460a883b9a1637deea42 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:57.095252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b428-13e1-41aa-9101-a8a7e0776a58 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.095544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b428-13e1-41aa-9101-a8a7e0776a58 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.095832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b428-13e1-41aa-9101-a8a7e0776a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.119887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-2466b428-13e1-41aa-9101-a8a7e0776a58 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:57.121125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-2466b428-13e1-41aa-9101-a8a7e0776a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:57.198849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1358/2719] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:57.207876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d842-cc8b-4f63-9eb3-8c3a6453ed4b None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.208385 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d842-cc8b-4f63-9eb3-8c3a6453ed4b None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.208792 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663d842-cc8b-4f63-9eb3-8c3a6453ed4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.239375 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-a663d842-cc8b-4f63-9eb3-8c3a6453ed4b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:57.240742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-a663d842-cc8b-4f63-9eb3-8c3a6453ed4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:57.253262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1362/2720] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:57.255102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466b428-13e1-41aa-9101-a8a7e0776a58 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:57.270649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466b428-13e1-41aa-9101-a8a7e0776a58 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:57.276766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:57.276766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.276766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.276766 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.277566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:44:57.278080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:57.280482 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:57.300991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1359/2721] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:44:57.302846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d842-cc8b-4f63-9eb3-8c3a6453ed4b None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:57.315925 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663d842-cc8b-4f63-9eb3-8c3a6453ed4b None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:57.322731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3995-881f-4514-9e73-d857fa5847e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:57.323704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3995-881f-4514-9e73-d857fa5847e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.323995 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3995-881f-4514-9e73-d857fa5847e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.324313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b3995-881f-4514-9e73-d857fa5847e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.325321 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3995-881f-4514-9e73-d857fa5847e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:57.327800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b3995-881f-4514-9e73-d857fa5847e7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:57.367589 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1363/2722] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:57 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:57.369643 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:57.383597 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40671868-355d-40fc-b4d7-dce7b91687dd admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:57.423130 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:57.476240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e6aea-c450-4532-b514-93ea4392528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:57.477003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e6aea-c450-4532-b514-93ea4392528d admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.477497 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e6aea-c450-4532-b514-93ea4392528d admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.478012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e6aea-c450-4532-b514-93ea4392528d admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.479100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e6aea-c450-4532-b514-93ea4392528d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:57.481818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e6aea-c450-4532-b514-93ea4392528d admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:57.509965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1360/2723] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:57 2022] POST /identity/v3/users => generated 280 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:57.513607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3995-881f-4514-9e73-d857fa5847e7 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:57.524469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b3995-881f-4514-9e73-d857fa5847e7 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:57.529434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306e466-d78c-4b9e-85b3-33d2a96aab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:57.530174 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306e466-d78c-4b9e-85b3-33d2a96aab38 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.530450 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306e466-d78c-4b9e-85b3-33d2a96aab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.530715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306e466-d78c-4b9e-85b3-33d2a96aab38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.531355 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306e466-d78c-4b9e-85b3-33d2a96aab38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:57.532958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306e466-d78c-4b9e-85b3-33d2a96aab38 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:57.544908 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1364/2724] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:44:57.549209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e6aea-c450-4532-b514-93ea4392528d admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:57.561850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e6aea-c450-4532-b514-93ea4392528d admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:57.567103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da913-af34-48f0-84c4-e3fe89323fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:57.567738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da913-af34-48f0-84c4-e3fe89323fca admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.568011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da913-af34-48f0-84c4-e3fe89323fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.568276 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da913-af34-48f0-84c4-e3fe89323fca admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.568930 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da913-af34-48f0-84c4-e3fe89323fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:57.570582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da913-af34-48f0-84c4-e3fe89323fca admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:57.581859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1361/2725] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:44:57.585865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306e466-d78c-4b9e-85b3-33d2a96aab38 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:57.596332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306e466-d78c-4b9e-85b3-33d2a96aab38 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:57.601111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:57.601871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.602219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.602557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] PATH_INFO: `/v3/projects/6b0ebb7793fb47c3833de0fa796203b6/users/1c4c81097e6840c0aafe531748c5fba8/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.618854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b0ebb7793fb47c3833de0fa796203b6, user_id=1c4c81097e6840c0aafe531748c5fba8, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:57.621704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:57.638803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1365/2726] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:57 2022] PUT /identity/v3/projects/6b0ebb7793fb47c3833de0fa796203b6/users/1c4c81097e6840c0aafe531748c5fba8/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:57.649191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913273f8-4a65-4508-8a1e-273efd03fec9 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.649489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913273f8-4a65-4508-8a1e-273efd03fec9 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.649877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913273f8-4a65-4508-8a1e-273efd03fec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.682140 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-913273f8-4a65-4508-8a1e-273efd03fec9 None None] MFA Rules not processed for user `1c4c81097e6840c0aafe531748c5fba8`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:57.683464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-913273f8-4a65-4508-8a1e-273efd03fec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:57.759517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1362/2727] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:57.797114 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:57.800048 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:57.867573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b599a6-dc26-4fdc-8840-dcccdda9916f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:57.872640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e404f3b4-1819-4f40-a298-d238c6496091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:57.873463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f3b4-1819-4f40-a298-d238c6496091 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:57.873818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f3b4-1819-4f40-a298-d238c6496091 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:57.874039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e404f3b4-1819-4f40-a298-d238c6496091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:57.883455 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404f3b4-1819-4f40-a298-d238c6496091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:57.884962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e404f3b4-1819-4f40-a298-d238c6496091 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:57.896503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1366/2728] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:57.912137 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913273f8-4a65-4508-8a1e-273efd03fec9 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:58.002487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913273f8-4a65-4508-8a1e-273efd03fec9 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:58.007599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:58.008776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:58.009215 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:58.009728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] PATH_INFO: `/v3/users/1c4c81097e6840c0aafe531748c5fba8` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:58.011827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4c81097e6840c0aafe531748c5fba8)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:58.015730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:58.072399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:58.080858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4c81097e6840c0aafe531748c5fba8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:58.081725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4c81097e6840c0aafe531748c5fba8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:58.092918 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4c81097e6840c0aafe531748c5fba8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:58.101433 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4c81097e6840c0aafe531748c5fba8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:58.102180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4c81097e6840c0aafe531748c5fba8'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:58.125852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1363/2729] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:44:57 2022] DELETE /identity/v3/users/1c4c81097e6840c0aafe531748c5fba8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:58.126884 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1b27-771a-4246-a721-45f4786faf01 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:58.127269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1b27-771a-4246-a721-45f4786faf01 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:58.127640 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a1b27-771a-4246-a721-45f4786faf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:58.151776 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e30a1b27-771a-4246-a721-45f4786faf01 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:58.153708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e30a1b27-771a-4246-a721-45f4786faf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:58.220833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:58.238242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1367/2730] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:44:58.248981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:58.250598 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:58.318449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ec8e2-5fb0-404c-a6e1-8f6aaa896b13 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:58.322723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdb610-bba8-4f59-8656-7ebb52d4e6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:58.323351 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb610-bba8-4f59-8656-7ebb52d4e6ea service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:58.323598 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb610-bba8-4f59-8656-7ebb52d4e6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:58.323828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdb610-bba8-4f59-8656-7ebb52d4e6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:58.335145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdb610-bba8-4f59-8656-7ebb52d4e6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:58.336499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdb610-bba8-4f59-8656-7ebb52d4e6ea service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:58.347188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1364/2731] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:44:58.934112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a1b27-771a-4246-a721-45f4786faf01 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:58.936755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e30a1b27-771a-4246-a721-45f4786faf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:58.952675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a1b27-771a-4246-a721-45f4786faf01 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:58.965158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:58.965989 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:58.966946 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:58.967438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] PATH_INFO: `/v3/projects/6b0ebb7793fb47c3833de0fa796203b6` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:58.968920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b0ebb7793fb47c3833de0fa796203b6)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:58.975876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:59.046719 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b0ebb7793fb47c3833de0fa796203b6', 'request_id': 'req-9dee5104-ac29-4b22-a939-1102942b54bf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:59.053352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b0ebb7793fb47c3833de0fa796203b6', 'request_id': 'req-9dee5104-ac29-4b22-a939-1102942b54bf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:59.063074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b0ebb7793fb47c3833de0fa796203b6', 'request_id': 'req-9dee5104-ac29-4b22-a939-1102942b54bf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:59.075507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] The token cache is being invalidate because project 6b0ebb7793fb47c3833de0fa796203b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:44:59.075932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:59.076715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9dee5104-ac29-4b22-a939-1102942b54bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:44:59.078417 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1368/2732] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:44:58 2022] DELETE /identity/v3/projects/6b0ebb7793fb47c3833de0fa796203b6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:59.083282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7cc4-9d89-4c65-a47b-f7272a57de9a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.083809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7cc4-9d89-4c65-a47b-f7272a57de9a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.083809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d7cc4-9d89-4c65-a47b-f7272a57de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.106760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-ae4d7cc4-9d89-4c65-a47b-f7272a57de9a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:59.106760 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ae4d7cc4-9d89-4c65-a47b-f7272a57de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:59.177733 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1365/2733] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:44:59.187428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ef91-c606-49eb-a15a-4ded543f9100 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.187428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ef91-c606-49eb-a15a-4ded543f9100 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.187428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada7ef91-c606-49eb-a15a-4ded543f9100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.208433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-ada7ef91-c606-49eb-a15a-4ded543f9100 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:59.209646 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-ada7ef91-c606-49eb-a15a-4ded543f9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:59.221115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1369/2734] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:59.222670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d7cc4-9d89-4c65-a47b-f7272a57de9a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:59.233357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d7cc4-9d89-4c65-a47b-f7272a57de9a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:59.238191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:59.238822 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.239142 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.239410 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.240102 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:44:59.240403 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:59.242396 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:59.261608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1366/2735] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:44:59.261856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7ef91-c606-49eb-a15a-4ded543f9100 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:59.275763 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada7ef91-c606-49eb-a15a-4ded543f9100 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:59.282207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496639ee-08b3-4ef6-a357-8a83d8163898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:59.283170 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496639ee-08b3-4ef6-a357-8a83d8163898 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.283511 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496639ee-08b3-4ef6-a357-8a83d8163898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.283967 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496639ee-08b3-4ef6-a357-8a83d8163898 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.284972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496639ee-08b3-4ef6-a357-8a83d8163898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:59.287703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496639ee-08b3-4ef6-a357-8a83d8163898 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:59.328695 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:59.330031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1370/2736] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:44:59 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:59.340013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28edb75-f2de-4e49-914a-500d9591fc02 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:59.393339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:44:59.409848 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3fb32-ed03-444f-9db6-e6fe4a858c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:59.410454 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3fb32-ed03-444f-9db6-e6fe4a858c85 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.410726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3fb32-ed03-444f-9db6-e6fe4a858c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.411006 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3fb32-ed03-444f-9db6-e6fe4a858c85 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.411635 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3fb32-ed03-444f-9db6-e6fe4a858c85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:59.413623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3fb32-ed03-444f-9db6-e6fe4a858c85 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:59.437832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1367/2737] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:44:59 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:44:59.442285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496639ee-08b3-4ef6-a357-8a83d8163898 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:59.453602 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496639ee-08b3-4ef6-a357-8a83d8163898 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:59.458879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ab21-7b36-45de-9221-bb3fdb73a201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:59.459739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ab21-7b36-45de-9221-bb3fdb73a201 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.460120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ab21-7b36-45de-9221-bb3fdb73a201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.460341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0ab21-7b36-45de-9221-bb3fdb73a201 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.461042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ab21-7b36-45de-9221-bb3fdb73a201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:59.462725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0ab21-7b36-45de-9221-bb3fdb73a201 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:59.473620 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1371/2738] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:59.477589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3fb32-ed03-444f-9db6-e6fe4a858c85 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:59.488386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3fb32-ed03-444f-9db6-e6fe4a858c85 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:59.493221 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3cf95-456d-4351-9d9c-c0ec86ac7d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:59.493882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cf95-456d-4351-9d9c-c0ec86ac7d2b admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.494163 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cf95-456d-4351-9d9c-c0ec86ac7d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.494470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cf95-456d-4351-9d9c-c0ec86ac7d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.495118 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3cf95-456d-4351-9d9c-c0ec86ac7d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:59.496731 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3cf95-456d-4351-9d9c-c0ec86ac7d2b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:59.512483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1368/2739] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:44:59.513742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ab21-7b36-45de-9221-bb3fdb73a201 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:59.524632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0ab21-7b36-45de-9221-bb3fdb73a201 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:59.529279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:59.529973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.530251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.530527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] PATH_INFO: `/v3/projects/5fedf222b6104701b82f535fa4ef74ac/users/56ed9985ca79417b8a1a1f2683f24225/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.546739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fedf222b6104701b82f535fa4ef74ac, user_id=56ed9985ca79417b8a1a1f2683f24225, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:59.549403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:59.565800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1372/2740] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:44:59 2022] PUT /identity/v3/projects/5fedf222b6104701b82f535fa4ef74ac/users/56ed9985ca79417b8a1a1f2683f24225/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:44:59.576367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a5bd-52d8-4a16-ab31-87e31fc33912 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.576661 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a5bd-52d8-4a16-ab31-87e31fc33912 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.576935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a5bd-52d8-4a16-ab31-87e31fc33912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.608977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1de4a5bd-52d8-4a16-ab31-87e31fc33912 None None] MFA Rules not processed for user `56ed9985ca79417b8a1a1f2683f24225`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:44:59.610255 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1de4a5bd-52d8-4a16-ab31-87e31fc33912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:59.679284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1369/2741] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:44:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:44:59.692124 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:44:59.694915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:44:59.752167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dcbe6-1622-4ae3-84e6-98880684bc81 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:44:59.756153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:44:59.757068 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:44:59.757429 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:44:59.757708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:44:59.767579 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:44:59.769020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:44:59.779210 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1373/2742] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:44:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:00.678610 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb270fa-4aa4-4135-923a-2f5d1dd48a6b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:00.679096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb270fa-4aa4-4135-923a-2f5d1dd48a6b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:00.679212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb270fa-4aa4-4135-923a-2f5d1dd48a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:00.700816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-cbb270fa-4aa4-4135-923a-2f5d1dd48a6b None None] MFA Rules not processed for user `e5757b587e93429bacdf4a1b7f17d00a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:00.701871 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cbb270fa-4aa4-4135-923a-2f5d1dd48a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:00.759079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1370/2743] 10.222.0.48 () {58 vars in 967 bytes} [Sat Sep 17 03:45:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:00.771999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:00.773746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:00.794261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:00.846530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb6988-592a-4b3a-8cc2-63b4103105b6 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:00.851803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '004e85a47ddd40f89d65bc5ffa817dc6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:00.852409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:00.852686 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:00.852955 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:00.861178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:00.862797 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:00.870982 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1374/2744] 10.222.0.48 () {60 vars in 1384 bytes} [Sat Sep 17 03:45:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 03:45:02.786329 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb270fa-4aa4-4135-923a-2f5d1dd48a6b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:02.787859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-cbb270fa-4aa4-4135-923a-2f5d1dd48a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:02.841593 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:02.844100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:02.858687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:02.865745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb270fa-4aa4-4135-923a-2f5d1dd48a6b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:02.871976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:02.872662 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:02.873004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:02.873408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:02.875204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:02.887416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:02.889404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:02.900823 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1371/2745] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:02.915498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7aded-06d8-4c13-a919-10b7df1b942a service swift] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:02.920717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:02.921442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:02.921813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:02.922147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] PATH_INFO: `/v3/users/844e860b3c6a40ff9ae1c59b61a27d08` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:02.923380 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] RBAC: Authorizing `identity:delete_user(user_id=844e860b3c6a40ff9ae1c59b61a27d08)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:02.925402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:02.974005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844e860b3c6a40ff9ae1c59b61a27d08'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:02.974669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844e860b3c6a40ff9ae1c59b61a27d08'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:02.982706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844e860b3c6a40ff9ae1c59b61a27d08'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:02.995885 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844e860b3c6a40ff9ae1c59b61a27d08'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:02.996598 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1bc1c37c-cdfa-4b92-bcc4-6b6a0c13f46c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844e860b3c6a40ff9ae1c59b61a27d08'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:03.009428 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1375/2746] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:45:02 2022] DELETE /identity/v3/users/844e860b3c6a40ff9ae1c59b61a27d08 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:03.206046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:03.221201 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e6d97-1926-46aa-b8e6-7821a4b1df4d service placement] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:03.285426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:03.286101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.286379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.286650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] PATH_INFO: `/v3/projects/2111cd52edcf4c9b83fad77dd2b32956` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.287784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2111cd52edcf4c9b83fad77dd2b32956)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:03.289698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:03.339688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2111cd52edcf4c9b83fad77dd2b32956', 'request_id': 'req-8be5b98f-7173-412f-b218-daa417d5cdfb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:03.345253 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2111cd52edcf4c9b83fad77dd2b32956', 'request_id': 'req-8be5b98f-7173-412f-b218-daa417d5cdfb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:03.351547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2111cd52edcf4c9b83fad77dd2b32956', 'request_id': 'req-8be5b98f-7173-412f-b218-daa417d5cdfb'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:03.364432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] The token cache is being invalidate because project 2111cd52edcf4c9b83fad77dd2b32956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:45:03.364717 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:03.365326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-8be5b98f-7173-412f-b218-daa417d5cdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:03.366955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1372/2747] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:45:03 2022] DELETE /identity/v3/projects/2111cd52edcf4c9b83fad77dd2b32956 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:03.372032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adbcc8-5b37-483c-822c-3e506f430028 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.372348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adbcc8-5b37-483c-822c-3e506f430028 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.372621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79adbcc8-5b37-483c-822c-3e506f430028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.393497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-79adbcc8-5b37-483c-822c-3e506f430028 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:03.394734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-79adbcc8-5b37-483c-822c-3e506f430028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:03.414610 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:03.457572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1376/2748] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:03.466278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b96ddb-31ba-4203-921b-5f40cde974ed None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.466557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b96ddb-31ba-4203-921b-5f40cde974ed None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.466849 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b96ddb-31ba-4203-921b-5f40cde974ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.486768 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-65b96ddb-31ba-4203-921b-5f40cde974ed None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:03.487957 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-65b96ddb-31ba-4203-921b-5f40cde974ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:03.495929 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1373/2749] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:03.500332 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adbcc8-5b37-483c-822c-3e506f430028 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:03.510337 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79adbcc8-5b37-483c-822c-3e506f430028 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:03.515212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:03.515816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.516088 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.516350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.516991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:45:03.517319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:03.518922 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:03.531742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1377/2750] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:45:03.536037 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b96ddb-31ba-4203-921b-5f40cde974ed None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:03.546229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b96ddb-31ba-4203-921b-5f40cde974ed None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:03.551238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c780d51-dfec-4096-b261-68d88e8b090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:03.551845 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780d51-dfec-4096-b261-68d88e8b090b admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.552116 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780d51-dfec-4096-b261-68d88e8b090b admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.552388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780d51-dfec-4096-b261-68d88e8b090b admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.553016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c780d51-dfec-4096-b261-68d88e8b090b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:03.554992 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c780d51-dfec-4096-b261-68d88e8b090b admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:03.585291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1374/2751] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:45:03 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:45:03.589287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:03.599130 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c7920-84f3-4db4-b1bf-990c44a683ed admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:03.660238 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117cff1-a947-4710-b021-5121b865acb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:03.660438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117cff1-a947-4710-b021-5121b865acb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.660705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117cff1-a947-4710-b021-5121b865acb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.660984 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117cff1-a947-4710-b021-5121b865acb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.662144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117cff1-a947-4710-b021-5121b865acb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:03.664109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117cff1-a947-4710-b021-5121b865acb3 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:03.694672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1378/2752] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:45:03 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:45:03.699054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c780d51-dfec-4096-b261-68d88e8b090b admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:03.710068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c780d51-dfec-4096-b261-68d88e8b090b admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:03.716057 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f23b-774d-46e0-869f-96f8a63be815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:03.716687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f23b-774d-46e0-869f-96f8a63be815 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.716968 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f23b-774d-46e0-869f-96f8a63be815 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.717237 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328f23b-774d-46e0-869f-96f8a63be815 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.717916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f23b-774d-46e0-869f-96f8a63be815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:03.719526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328f23b-774d-46e0-869f-96f8a63be815 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:03.730103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1375/2753] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:45:03.734305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117cff1-a947-4710-b021-5121b865acb3 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:03.745341 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117cff1-a947-4710-b021-5121b865acb3 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:03.751391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997300b-f95b-409b-a270-1806cd13fffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:03.752005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997300b-f95b-409b-a270-1806cd13fffb admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.752263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997300b-f95b-409b-a270-1806cd13fffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.752554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997300b-f95b-409b-a270-1806cd13fffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.753173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997300b-f95b-409b-a270-1806cd13fffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:03.754844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997300b-f95b-409b-a270-1806cd13fffb admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:03.766396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1379/2754] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:45:03.770732 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f23b-774d-46e0-869f-96f8a63be815 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:03.781475 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328f23b-774d-46e0-869f-96f8a63be815 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:03.786264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:03.786915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.787517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.787517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] PATH_INFO: `/v3/projects/1394a52bcdbf415b9daea65fa78b84fe/users/86f8cc1abb82447699658fa2601ccd00/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.802622 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1394a52bcdbf415b9daea65fa78b84fe, user_id=86f8cc1abb82447699658fa2601ccd00, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:03.805287 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:03.819262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1376/2755] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:45:03 2022] PUT /identity/v3/projects/1394a52bcdbf415b9daea65fa78b84fe/users/86f8cc1abb82447699658fa2601ccd00/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:03.829723 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a2e7-ef32-4817-9d87-3b2a9db21a02 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:03.830067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a2e7-ef32-4817-9d87-3b2a9db21a02 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:03.830310 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4a2e7-ef32-4817-9d87-3b2a9db21a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:03.859875 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-e8b4a2e7-ef32-4817-9d87-3b2a9db21a02 None None] MFA Rules not processed for user `86f8cc1abb82447699658fa2601ccd00`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:03.861123 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e8b4a2e7-ef32-4817-9d87-3b2a9db21a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:03.931461 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1380/2756] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:03.943316 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:03.945111 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:03.964462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:04.018258 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc52da-16c6-4431-95ce-566be04ae249 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:04.023937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9665d05-2e56-4cb1-aa05-f9040d8ab506 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:04.024793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665d05-2e56-4cb1-aa05-f9040d8ab506 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:04.025068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665d05-2e56-4cb1-aa05-f9040d8ab506 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:04.025336 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9665d05-2e56-4cb1-aa05-f9040d8ab506 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:04.038939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9665d05-2e56-4cb1-aa05-f9040d8ab506 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:04.041187 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9665d05-2e56-4cb1-aa05-f9040d8ab506 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:04.051101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1377/2757] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:11.304912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4a2e7-ef32-4817-9d87-3b2a9db21a02 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:11.306514 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-e8b4a2e7-ef32-4817-9d87-3b2a9db21a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:11.330285 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:11.439359 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4a2e7-ef32-4817-9d87-3b2a9db21a02 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:11.444195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:11.444825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:11.445097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:11.445368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] PATH_INFO: `/v3/users/56ed9985ca79417b8a1a1f2683f24225` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:11.446524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=56ed9985ca79417b8a1a1f2683f24225)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:11.448540 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:11.498001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56ed9985ca79417b8a1a1f2683f24225'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:11.498661 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56ed9985ca79417b8a1a1f2683f24225'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:11.508320 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56ed9985ca79417b8a1a1f2683f24225'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:11.520270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56ed9985ca79417b8a1a1f2683f24225'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:11.520903 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56ed9985ca79417b8a1a1f2683f24225'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:11.532551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1381/2758] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:45:11 2022] DELETE /identity/v3/users/56ed9985ca79417b8a1a1f2683f24225 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:11.537259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7d6c-415b-4f32-a0fb-883fd6e8ac98 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:11.537801 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7d6c-415b-4f32-a0fb-883fd6e8ac98 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:11.537905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef7d6c-415b-4f32-a0fb-883fd6e8ac98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:11.567020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c2ef7d6c-415b-4f32-a0fb-883fd6e8ac98 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:11.568250 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c2ef7d6c-415b-4f32-a0fb-883fd6e8ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:11.627530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1378/2759] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:45:11.638129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:11.640356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:11.688827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:11.723202 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb1752-e198-47cd-8150-b006b1010c0f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:11.727183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea9430-7b62-4506-94cf-cb31e2d9afa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:11.727785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9430-7b62-4506-94cf-cb31e2d9afa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:11.728056 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9430-7b62-4506-94cf-cb31e2d9afa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:11.728325 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea9430-7b62-4506-94cf-cb31e2d9afa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:11.737709 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea9430-7b62-4506-94cf-cb31e2d9afa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:11.739242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea9430-7b62-4506-94cf-cb31e2d9afa1 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:11.748706 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1382/2760] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:12.024855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7d6c-415b-4f32-a0fb-883fd6e8ac98 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.026466 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c2ef7d6c-415b-4f32-a0fb-883fd6e8ac98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:12.039408 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef7d6c-415b-4f32-a0fb-883fd6e8ac98 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.045246 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.046061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.046342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.046609 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] PATH_INFO: `/v3/projects/5fedf222b6104701b82f535fa4ef74ac` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.047812 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fedf222b6104701b82f535fa4ef74ac)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.049840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:12.100919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fedf222b6104701b82f535fa4ef74ac', 'request_id': 'req-64fff47e-a1c4-45d3-bfe0-43954ab579db'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:12.106455 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fedf222b6104701b82f535fa4ef74ac', 'request_id': 'req-64fff47e-a1c4-45d3-bfe0-43954ab579db'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:12.112677 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fedf222b6104701b82f535fa4ef74ac', 'request_id': 'req-64fff47e-a1c4-45d3-bfe0-43954ab579db'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:12.126320 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] The token cache is being invalidate because project 5fedf222b6104701b82f535fa4ef74ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:45:12.126605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:12.127284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-64fff47e-a1c4-45d3-bfe0-43954ab579db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:12.128816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1379/2761] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:45:12 2022] DELETE /identity/v3/projects/5fedf222b6104701b82f535fa4ef74ac => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:12.134172 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc286-74cd-4a7c-8eb5-0e35b1cf171d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.134462 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc286-74cd-4a7c-8eb5-0e35b1cf171d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.134733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208cc286-74cd-4a7c-8eb5-0e35b1cf171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.185666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-208cc286-74cd-4a7c-8eb5-0e35b1cf171d None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:12.187178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-208cc286-74cd-4a7c-8eb5-0e35b1cf171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:12.254558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1383/2762] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:12.263718 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f5de6-4230-4938-a12c-9371bcc47d5e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.263991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f5de6-4230-4938-a12c-9371bcc47d5e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.264232 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f5de6-4230-4938-a12c-9371bcc47d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.284369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f00f5de6-4230-4938-a12c-9371bcc47d5e None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:12.285548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f00f5de6-4230-4938-a12c-9371bcc47d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:12.293961 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1380/2763] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:12.298311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cc286-74cd-4a7c-8eb5-0e35b1cf171d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.308725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208cc286-74cd-4a7c-8eb5-0e35b1cf171d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.314329 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.315168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.315443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.315728 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.316391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:45:12.316657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.318286 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:12.330623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1384/2764] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 03:45:12.335241 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f5de6-4230-4938-a12c-9371bcc47d5e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.344425 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f5de6-4230-4938-a12c-9371bcc47d5e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.349313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142bc9-ed15-4adb-80a9-719df38dcfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.349988 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142bc9-ed15-4adb-80a9-719df38dcfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.350218 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142bc9-ed15-4adb-80a9-719df38dcfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.350489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35142bc9-ed15-4adb-80a9-719df38dcfe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.351122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35142bc9-ed15-4adb-80a9-719df38dcfe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.353015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35142bc9-ed15-4adb-80a9-719df38dcfe4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:12.381188 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1381/2765] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:45:12 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:45:12.385641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.395623 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0953c-3bae-4f3f-ab67-71e36202d5f0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.452292 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb00d7-8c86-4161-a673-8f96d3e86bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.452870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb00d7-8c86-4161-a673-8f96d3e86bdd admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.453144 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb00d7-8c86-4161-a673-8f96d3e86bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.453410 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fb00d7-8c86-4161-a673-8f96d3e86bdd admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.454122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb00d7-8c86-4161-a673-8f96d3e86bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.456049 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fb00d7-8c86-4161-a673-8f96d3e86bdd admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:12.479081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1385/2766] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:45:12 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:45:12.483506 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142bc9-ed15-4adb-80a9-719df38dcfe4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.494003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35142bc9-ed15-4adb-80a9-719df38dcfe4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.498855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a9608-7f87-4a2f-9082-9ac4e1dbacba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.499436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a9608-7f87-4a2f-9082-9ac4e1dbacba admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.499715 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a9608-7f87-4a2f-9082-9ac4e1dbacba admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.499981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a9608-7f87-4a2f-9082-9ac4e1dbacba admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.500667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a9608-7f87-4a2f-9082-9ac4e1dbacba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.502372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a9608-7f87-4a2f-9082-9ac4e1dbacba admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:12.503640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:12.522013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1382/2767] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:45:12.522153 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb00d7-8c86-4161-a673-8f96d3e86bdd admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.535426 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fb00d7-8c86-4161-a673-8f96d3e86bdd admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.540476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4c47e-dde7-41df-b925-9fc9ae3bb570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.541175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c47e-dde7-41df-b925-9fc9ae3bb570 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.541536 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c47e-dde7-41df-b925-9fc9ae3bb570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.541907 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4c47e-dde7-41df-b925-9fc9ae3bb570 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.542612 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4c47e-dde7-41df-b925-9fc9ae3bb570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.544209 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4c47e-dde7-41df-b925-9fc9ae3bb570 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:12.555297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1386/2768] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:45:12.559576 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a9608-7f87-4a2f-9082-9ac4e1dbacba admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.572921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a9608-7f87-4a2f-9082-9ac4e1dbacba admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.578158 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d70200-01ea-4ad9-87ac-fb4ef4da2891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.580353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70200-01ea-4ad9-87ac-fb4ef4da2891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.580353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70200-01ea-4ad9-87ac-fb4ef4da2891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.580353 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d70200-01ea-4ad9-87ac-fb4ef4da2891 admin admin] PATH_INFO: `/v3/projects/2e072297162f406f88d50d64ac77f5b3/users/f5ac322618e64f4d87819954eca6686a/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.606245 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d70200-01ea-4ad9-87ac-fb4ef4da2891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e072297162f406f88d50d64ac77f5b3, user_id=f5ac322618e64f4d87819954eca6686a, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.608984 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d70200-01ea-4ad9-87ac-fb4ef4da2891 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:12.622486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1383/2769] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:45:12 2022] PUT /identity/v3/projects/2e072297162f406f88d50d64ac77f5b3/users/f5ac322618e64f4d87819954eca6686a/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:12.689038 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17fe40-789c-42bb-8fe3-0c1887eea88d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.689386 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17fe40-789c-42bb-8fe3-0c1887eea88d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.689567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd17fe40-789c-42bb-8fe3-0c1887eea88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.702947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:12.718318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-bd17fe40-789c-42bb-8fe3-0c1887eea88d None None] MFA Rules not processed for user `f5ac322618e64f4d87819954eca6686a`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:12.719573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bd17fe40-789c-42bb-8fe3-0c1887eea88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:12.788637 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1387/2770] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:12.793313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d70200-01ea-4ad9-87ac-fb4ef4da2891 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.866028 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d70200-01ea-4ad9-87ac-fb4ef4da2891 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.871264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f730d-f130-49e6-943b-8ff9e7761271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.871901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f730d-f130-49e6-943b-8ff9e7761271 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.872180 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f730d-f130-49e6-943b-8ff9e7761271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.872449 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f730d-f130-49e6-943b-8ff9e7761271 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.873083 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f730d-f130-49e6-943b-8ff9e7761271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.875082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f730d-f130-49e6-943b-8ff9e7761271 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:12.906740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1384/2771] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:45:12 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:45:12.911981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17fe40-789c-42bb-8fe3-0c1887eea88d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:12.923525 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd17fe40-789c-42bb-8fe3-0c1887eea88d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:12.984059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb809ce3-a783-4bb0-8aa1-455585d73567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:12.984059 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb809ce3-a783-4bb0-8aa1-455585d73567 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:12.984327 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb809ce3-a783-4bb0-8aa1-455585d73567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:12.984629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb809ce3-a783-4bb0-8aa1-455585d73567 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:12.985275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb809ce3-a783-4bb0-8aa1-455585d73567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:12.987469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb809ce3-a783-4bb0-8aa1-455585d73567 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.010212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1388/2772] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:45:12 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:45:13.014302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f730d-f130-49e6-943b-8ff9e7761271 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.025013 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f730d-f130-49e6-943b-8ff9e7761271 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.030330 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45204ef0-0ea1-4b1c-af27-130408bd9a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.030931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45204ef0-0ea1-4b1c-af27-130408bd9a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.031207 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45204ef0-0ea1-4b1c-af27-130408bd9a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.031476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45204ef0-0ea1-4b1c-af27-130408bd9a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.032115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45204ef0-0ea1-4b1c-af27-130408bd9a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.033728 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45204ef0-0ea1-4b1c-af27-130408bd9a69 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.044603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1385/2773] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:45:13.048684 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb809ce3-a783-4bb0-8aa1-455585d73567 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.059206 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb809ce3-a783-4bb0-8aa1-455585d73567 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.064350 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148babd1-aa07-4693-ad1c-a95fe6084ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.065074 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148babd1-aa07-4693-ad1c-a95fe6084ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.065348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148babd1-aa07-4693-ad1c-a95fe6084ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.065630 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148babd1-aa07-4693-ad1c-a95fe6084ce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.066298 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148babd1-aa07-4693-ad1c-a95fe6084ce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.067893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148babd1-aa07-4693-ad1c-a95fe6084ce0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.078470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1389/2774] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:45:13.082946 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45204ef0-0ea1-4b1c-af27-130408bd9a69 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.093544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45204ef0-0ea1-4b1c-af27-130408bd9a69 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.099342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784663-06cb-4689-8224-88f888200fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.099991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784663-06cb-4689-8224-88f888200fb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.100265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784663-06cb-4689-8224-88f888200fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.100532 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784663-06cb-4689-8224-88f888200fb0 admin admin] PATH_INFO: `/v3/projects/a6e9c132f05c4b4bb2c21cecac5b35b7/users/00c096b61235442b8fe48de31f29ce0f/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.115520 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d784663-06cb-4689-8224-88f888200fb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e9c132f05c4b4bb2c21cecac5b35b7, user_id=00c096b61235442b8fe48de31f29ce0f, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.118248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d784663-06cb-4689-8224-88f888200fb0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.132743 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1386/2775] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:45:13 2022] PUT /identity/v3/projects/a6e9c132f05c4b4bb2c21cecac5b35b7/users/00c096b61235442b8fe48de31f29ce0f/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:13.143460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759c34-6219-433c-93c3-6c9aac7b5b92 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.143746 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759c34-6219-433c-93c3-6c9aac7b5b92 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.144017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759c34-6219-433c-93c3-6c9aac7b5b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.172097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-59759c34-6219-433c-93c3-6c9aac7b5b92 None None] MFA Rules not processed for user `00c096b61235442b8fe48de31f29ce0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:13.173305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-59759c34-6219-433c-93c3-6c9aac7b5b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:13.241367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1390/2776] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:13.246064 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784663-06cb-4689-8224-88f888200fb0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.309866 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784663-06cb-4689-8224-88f888200fb0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.314630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ccddc-2d9d-4b11-880c-2d55b1bcb7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.315277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ccddc-2d9d-4b11-880c-2d55b1bcb7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.315558 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ccddc-2d9d-4b11-880c-2d55b1bcb7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.315830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ccddc-2d9d-4b11-880c-2d55b1bcb7e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.316459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ccddc-2d9d-4b11-880c-2d55b1bcb7e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.318404 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ccddc-2d9d-4b11-880c-2d55b1bcb7e7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.348376 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1387/2777] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:45:13 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:45:13.352663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759c34-6219-433c-93c3-6c9aac7b5b92 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.359491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:13.364507 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759c34-6219-433c-93c3-6c9aac7b5b92 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.430844 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636f039-386a-491f-bf46-158be8ec1a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.431460 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f039-386a-491f-bf46-158be8ec1a64 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.431755 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f039-386a-491f-bf46-158be8ec1a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.432019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a636f039-386a-491f-bf46-158be8ec1a64 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.432644 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636f039-386a-491f-bf46-158be8ec1a64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.434617 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a636f039-386a-491f-bf46-158be8ec1a64 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.457669 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1391/2778] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:45:13 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:45:13.461859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ccddc-2d9d-4b11-880c-2d55b1bcb7e7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.472621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ccddc-2d9d-4b11-880c-2d55b1bcb7e7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.477704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f39c-a13d-40ed-960f-78f2db778b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.478358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f39c-a13d-40ed-960f-78f2db778b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.478667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f39c-a13d-40ed-960f-78f2db778b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.479098 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f39c-a13d-40ed-960f-78f2db778b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.479777 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f39c-a13d-40ed-960f-78f2db778b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.481570 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f39c-a13d-40ed-960f-78f2db778b00 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.483063 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:13.513171 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1388/2779] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:45:13.517529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636f039-386a-491f-bf46-158be8ec1a64 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.528015 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a636f039-386a-491f-bf46-158be8ec1a64 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.533475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2780e-d2bf-45e7-b38b-a19e8eb69813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.534171 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2780e-d2bf-45e7-b38b-a19e8eb69813 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.534445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2780e-d2bf-45e7-b38b-a19e8eb69813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.534713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2780e-d2bf-45e7-b38b-a19e8eb69813 admin admin] PATH_INFO: `/v3/projects/142afca6086b4c62b54139e6845b75d9/users/5741e325a9234aa3b8087c1433707adf/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.550160 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2780e-d2bf-45e7-b38b-a19e8eb69813 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142afca6086b4c62b54139e6845b75d9, user_id=5741e325a9234aa3b8087c1433707adf, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.552789 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2780e-d2bf-45e7-b38b-a19e8eb69813 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.568363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1392/2780] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:45:13 2022] PUT /identity/v3/projects/142afca6086b4c62b54139e6845b75d9/users/5741e325a9234aa3b8087c1433707adf/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:13.572270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f39c-a13d-40ed-960f-78f2db778b00 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.582364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f39c-a13d-40ed-960f-78f2db778b00 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.651873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16604f4-53a3-452a-b0ec-f574364a3185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.652493 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16604f4-53a3-452a-b0ec-f574364a3185 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.652878 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16604f4-53a3-452a-b0ec-f574364a3185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.653002 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16604f4-53a3-452a-b0ec-f574364a3185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.653654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16604f4-53a3-452a-b0ec-f574364a3185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.655292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16604f4-53a3-452a-b0ec-f574364a3185 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.670040 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1389/2781] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:45:13.671499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2780e-d2bf-45e7-b38b-a19e8eb69813 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.682488 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2780e-d2bf-45e7-b38b-a19e8eb69813 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.687129 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.687813 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.688122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.688397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] PATH_INFO: `/v3/projects/142afca6086b4c62b54139e6845b75d9/users/5741e325a9234aa3b8087c1433707adf/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.690717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=142afca6086b4c62b54139e6845b75d9, user_id=5741e325a9234aa3b8087c1433707adf, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.693545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.704382 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1393/2782] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:45:13 2022] PUT /identity/v3/projects/142afca6086b4c62b54139e6845b75d9/users/5741e325a9234aa3b8087c1433707adf/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:13.716367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac22f-c90a-4ee3-879a-b576e28cbf33 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.716774 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac22f-c90a-4ee3-879a-b576e28cbf33 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.717084 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cac22f-c90a-4ee3-879a-b576e28cbf33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.747935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-44cac22f-c90a-4ee3-879a-b576e28cbf33 None None] MFA Rules not processed for user `5741e325a9234aa3b8087c1433707adf`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:13.749416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-44cac22f-c90a-4ee3-879a-b576e28cbf33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:13.832729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1390/2783] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:13.844070 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:13.845894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:13.908990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a77ce7-5302-47dc-bde1-9292eda7ab12 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:13.912865 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d9d0e-d097-4945-a193-6d47b27bb911 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:13.913497 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d9d0e-d097-4945-a193-6d47b27bb911 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:13.913800 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d9d0e-d097-4945-a193-6d47b27bb911 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:13.914075 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d9d0e-d097-4945-a193-6d47b27bb911 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:13.971021 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d9d0e-d097-4945-a193-6d47b27bb911 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:13.972529 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d9d0e-d097-4945-a193-6d47b27bb911 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:13.981823 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1394/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:15.505447 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cac22f-c90a-4ee3-879a-b576e28cbf33 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:15.515660 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cac22f-c90a-4ee3-879a-b576e28cbf33 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:15.519306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:15.519907 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:15.520186 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:15.520459 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:15.577039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:15.578679 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:15.588033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1391/2785] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:16.209781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d9d0e-d097-4945-a193-6d47b27bb911 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:16.220451 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d9d0e-d097-4945-a193-6d47b27bb911 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:16.224581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f62508-8493-4bd9-a689-6b3c719d18ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:16.225204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62508-8493-4bd9-a689-6b3c719d18ca service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:16.225482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62508-8493-4bd9-a689-6b3c719d18ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:16.225775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f62508-8493-4bd9-a689-6b3c719d18ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:16.237260 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f62508-8493-4bd9-a689-6b3c719d18ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:16.238928 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f62508-8493-4bd9-a689-6b3c719d18ca service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:16.245691 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:16.272243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1395/2786] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:19.682179 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:19.683898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:19.707059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=100 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:19.805243 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859176ae-fc3b-44f0-8ee5-d0f63e15530f service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:19.810767 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832f2a-35ca-4565-bbc0-4ff7c2041e62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:19.811386 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832f2a-35ca-4565-bbc0-4ff7c2041e62 service placement] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:19.811665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832f2a-35ca-4565-bbc0-4ff7c2041e62 service placement] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:19.811933 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832f2a-35ca-4565-bbc0-4ff7c2041e62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:19.814259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9a832f2a-35ca-4565-bbc0-4ff7c2041e62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:19.826704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832f2a-35ca-4565-bbc0-4ff7c2041e62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:19.828335 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832f2a-35ca-4565-bbc0-4ff7c2041e62 service placement] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:19.838152 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1392/2787] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:20.243356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f62508-8493-4bd9-a689-6b3c719d18ca service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:20.316427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f62508-8493-4bd9-a689-6b3c719d18ca service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:20.321433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:20.322121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:20.322396 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:20.322668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] PATH_INFO: `/v3/users/f5ac322618e64f4d87819954eca6686a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:20.324319 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ac322618e64f4d87819954eca6686a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:20.326149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:20.381372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ac322618e64f4d87819954eca6686a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:20.382077 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ac322618e64f4d87819954eca6686a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:20.391562 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ac322618e64f4d87819954eca6686a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:20.406106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ac322618e64f4d87819954eca6686a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:20.406851 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ac322618e64f4d87819954eca6686a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:20.420566 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1396/2788] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:45:20 2022] DELETE /identity/v3/users/f5ac322618e64f4d87819954eca6686a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:20.425087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8a68-98ca-4abe-82d6-c1436e5ba7f0 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:20.425371 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8a68-98ca-4abe-82d6-c1436e5ba7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:20.425641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8a68-98ca-4abe-82d6-c1436e5ba7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:20.447683 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-c51d8a68-98ca-4abe-82d6-c1436e5ba7f0 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:20.448952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c51d8a68-98ca-4abe-82d6-c1436e5ba7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:20.517955 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1393/2789] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:20.526407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:20.528093 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:20.587046 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0290cebd-5800-4a16-bb92-065394d004b4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:20.591935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce1efe-6e97-4aad-9963-26fdcd3886c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:20.592557 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1efe-6e97-4aad-9963-26fdcd3886c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:20.592843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1efe-6e97-4aad-9963-26fdcd3886c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:20.593116 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce1efe-6e97-4aad-9963-26fdcd3886c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:20.603229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce1efe-6e97-4aad-9963-26fdcd3886c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:20.604735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce1efe-6e97-4aad-9963-26fdcd3886c5 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:20.616534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1397/2790] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:20.904601 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d8a68-98ca-4abe-82d6-c1436e5ba7f0 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:20.906256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-c51d8a68-98ca-4abe-82d6-c1436e5ba7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:20.920388 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d8a68-98ca-4abe-82d6-c1436e5ba7f0 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:20.925792 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:20.927066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:20.927066 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:20.927417 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] PATH_INFO: `/v3/projects/2e072297162f406f88d50d64ac77f5b3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:20.928758 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e072297162f406f88d50d64ac77f5b3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:20.930883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:20.981608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e072297162f406f88d50d64ac77f5b3', 'request_id': 'req-d5058262-098d-424f-8a7e-fd652b6ecdde'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:20.989764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e072297162f406f88d50d64ac77f5b3', 'request_id': 'req-d5058262-098d-424f-8a7e-fd652b6ecdde'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:20.996436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e072297162f406f88d50d64ac77f5b3', 'request_id': 'req-d5058262-098d-424f-8a7e-fd652b6ecdde'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.009509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] The token cache is being invalidate because project 2e072297162f406f88d50d64ac77f5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:45:21.009817 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.010461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.012452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1394/2791] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:45:20 2022] DELETE /identity/v3/projects/2e072297162f406f88d50d64ac77f5b3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:45:21.017456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce1efe-6e97-4aad-9963-26fdcd3886c5 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:21.027835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce1efe-6e97-4aad-9963-26fdcd3886c5 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:21.044062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:21.093662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:21.094312 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:21.094586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:21.094854 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] PATH_INFO: `/v3/users/00c096b61235442b8fe48de31f29ce0f` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:21.096005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c096b61235442b8fe48de31f29ce0f)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:21.097953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:21.146433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c096b61235442b8fe48de31f29ce0f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.147135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c096b61235442b8fe48de31f29ce0f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.155524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c096b61235442b8fe48de31f29ce0f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.168369 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c096b61235442b8fe48de31f29ce0f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.169008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c096b61235442b8fe48de31f29ce0f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.182404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1398/2792] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:45:21 2022] DELETE /identity/v3/users/00c096b61235442b8fe48de31f29ce0f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:21.465830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:21.467344 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:21.481096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5058262-098d-424f-8a7e-fd652b6ecdde admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:21.489632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:21.549049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:21.549698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:21.549990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:21.550254 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] PATH_INFO: `/v3/projects/a6e9c132f05c4b4bb2c21cecac5b35b7` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:21.551426 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e9c132f05c4b4bb2c21cecac5b35b7)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:21.553432 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:21.604416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e9c132f05c4b4bb2c21cecac5b35b7', 'request_id': 'req-506759b2-e242-4ea1-91d0-2061859bbfc0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.613891 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e9c132f05c4b4bb2c21cecac5b35b7', 'request_id': 'req-506759b2-e242-4ea1-91d0-2061859bbfc0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.621565 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e9c132f05c4b4bb2c21cecac5b35b7', 'request_id': 'req-506759b2-e242-4ea1-91d0-2061859bbfc0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.637129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] The token cache is being invalidate because project a6e9c132f05c4b4bb2c21cecac5b35b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:45:21.637416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.638047 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.639531 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1395/2793] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:45:21 2022] DELETE /identity/v3/projects/a6e9c132f05c4b4bb2c21cecac5b35b7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:21.643716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:21.645126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:21.660294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9726e2f-307d-47b6-bf63-b34d5a60b3d4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:21.731368 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:21.732193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:21.732469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:21.732733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] PATH_INFO: `/v3/users/5741e325a9234aa3b8087c1433707adf` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:21.734333 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5741e325a9234aa3b8087c1433707adf)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:21.736314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:21.788440 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:21.794818 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5741e325a9234aa3b8087c1433707adf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.795597 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5741e325a9234aa3b8087c1433707adf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.804443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5741e325a9234aa3b8087c1433707adf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.816221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5741e325a9234aa3b8087c1433707adf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.816920 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-993266ae-ecb2-40ff-832a-3555688b4d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5741e325a9234aa3b8087c1433707adf'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:21.830183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1399/2794] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:45:21 2022] DELETE /identity/v3/users/5741e325a9234aa3b8087c1433707adf => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:22.155377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:22.158723 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:22.172852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506759b2-e242-4ea1-91d0-2061859bbfc0 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:22.237908 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:22.238548 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:22.238832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:22.239106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] PATH_INFO: `/v3/projects/142afca6086b4c62b54139e6845b75d9` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:22.240275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=142afca6086b4c62b54139e6845b75d9)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:22.242379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:22.290877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:22.303773 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '142afca6086b4c62b54139e6845b75d9', 'request_id': 'req-43dc4333-bcff-49b9-9360-124440f1aed7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:22.309470 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '142afca6086b4c62b54139e6845b75d9', 'request_id': 'req-43dc4333-bcff-49b9-9360-124440f1aed7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:22.315803 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '142afca6086b4c62b54139e6845b75d9', 'request_id': 'req-43dc4333-bcff-49b9-9360-124440f1aed7'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:22.331677 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] The token cache is being invalidate because project 142afca6086b4c62b54139e6845b75d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:45:22.332093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:22.332740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:22.335504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1396/2795] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:45:22 2022] DELETE /identity/v3/projects/142afca6086b4c62b54139e6845b75d9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:27.461981 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8776a2-cf12-4a7c-957e-17bf85497f72 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:27.462549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8776a2-cf12-4a7c-957e-17bf85497f72 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:27.462549 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8776a2-cf12-4a7c-957e-17bf85497f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:27.482456 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-1d8776a2-cf12-4a7c-957e-17bf85497f72 None None] MFA Rules not processed for user `8f119e7a0b66415ab88cd641886c2e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:27.483676 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1d8776a2-cf12-4a7c-957e-17bf85497f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:27.539814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1400/2796] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:45:32.327535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=9,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:34.418747 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:34.420442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:34.487193 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc4333-bcff-49b9-9360-124440f1aed7 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:34.492476 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:34.493100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:34.493380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:34.493647 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] PATH_INFO: `/v3/users/86f8cc1abb82447699658fa2601ccd00` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:34.494837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f8cc1abb82447699658fa2601ccd00)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:34.496769 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:34.547619 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f8cc1abb82447699658fa2601ccd00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:34.548265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f8cc1abb82447699658fa2601ccd00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:34.557076 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f8cc1abb82447699658fa2601ccd00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:34.564618 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f8cc1abb82447699658fa2601ccd00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:34.565262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f8cc1abb82447699658fa2601ccd00'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:34.582648 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1397/2797] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:45:34 2022] DELETE /identity/v3/users/86f8cc1abb82447699658fa2601ccd00 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:34.587360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490c51-4434-44a5-b962-366955f63540 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:34.587883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490c51-4434-44a5-b962-366955f63540 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:34.587883 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55490c51-4434-44a5-b962-366955f63540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:34.606899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-55490c51-4434-44a5-b962-366955f63540 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:45:34.608103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-55490c51-4434-44a5-b962-366955f63540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:34.668063 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1401/2798] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:45:34.678176 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:34.680630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:34.766666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e433174-b5a1-4eb8-9a4d-fa7791140a3f admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:34.770805 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:34.771421 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:34.771700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:34.771977 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:34.781889 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:34.783375 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:34.793504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1398/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:35.071280 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55490c51-4434-44a5-b962-366955f63540 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:35.072803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-55490c51-4434-44a5-b962-366955f63540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:35.085545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55490c51-4434-44a5-b962-366955f63540 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:35.090971 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:35.091606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:35.091880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:35.092143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] PATH_INFO: `/v3/projects/1394a52bcdbf415b9daea65fa78b84fe` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:35.093288 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1394a52bcdbf415b9daea65fa78b84fe)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:35.095219 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:35.143534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1394a52bcdbf415b9daea65fa78b84fe', 'request_id': 'req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:35.150000 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1394a52bcdbf415b9daea65fa78b84fe', 'request_id': 'req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:35.153712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:35.160582 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1394a52bcdbf415b9daea65fa78b84fe', 'request_id': 'req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:35.172022 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] The token cache is being invalidate because project 1394a52bcdbf415b9daea65fa78b84fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:45:35.172307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:35.172941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:45:35.174578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1402/2800] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:45:35 2022] DELETE /identity/v3/projects/1394a52bcdbf415b9daea65fa78b84fe => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:45:44.788950 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:45.169294 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=4,keystone:DELETE=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:45:49.486062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:49.487673 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:49.595672 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083a5a6-ba50-4852-888d-bdc472f28e71 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:49.660486 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fda0f612b2ec42b2beac9af0b49ccff0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:49.661089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:49.661357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:49.661630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:49.663654 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:49.721325 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:49.722888 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:49.731900 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1399/2801] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:54.619414 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:45:54.621020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:54.681373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ebb466-8b6d-48c5-95bd-5d9bfbf43b3c admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:45:54.685224 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:45:54.685864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:45:54.686143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:45:54.686418 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:45:54.688256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:45:54.755745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:45:54.757638 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:45:54.767974 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1403/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:45:59.727707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:46:01.202428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:46:01.203904 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:46:01.217652 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580779e-2f62-474f-a4ce-0eb3e370a763 service nova] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:46:01.222552 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:46:01.223190 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:46:01.223464 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:46:01.223763 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] PATH_INFO: `/v3/users/2e1fa41a10bc4f5883e12f41c811b125` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:46:01.224869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1fa41a10bc4f5883e12f41c811b125)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:46:01.226995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:46:01.279700 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1fa41a10bc4f5883e12f41c811b125'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.280395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1fa41a10bc4f5883e12f41c811b125'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.289364 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1fa41a10bc4f5883e12f41c811b125'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.296401 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1fa41a10bc4f5883e12f41c811b125'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.297039 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1fa41a10bc4f5883e12f41c811b125'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.314828 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1400/2803] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:46:01 2022] DELETE /identity/v3/users/2e1fa41a10bc4f5883e12f41c811b125 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:46:01.504843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:46:01.515521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee1e8d-1be9-4f87-82b4-a74903c1004c service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:46:01.573825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:46:01.574463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:46:01.574744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:46:01.575020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] PATH_INFO: `/v3/projects/edd573977cb64f70b39b2ef5d1ed1cb7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:46:01.576262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd573977cb64f70b39b2ef5d1ed1cb7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:46:01.578251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:46:01.627947 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd573977cb64f70b39b2ef5d1ed1cb7', 'request_id': 'req-4ee9a71f-e030-40ce-9a62-60f4bcac5167'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.629814 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:46:01.635016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd573977cb64f70b39b2ef5d1ed1cb7', 'request_id': 'req-4ee9a71f-e030-40ce-9a62-60f4bcac5167'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.643403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd573977cb64f70b39b2ef5d1ed1cb7', 'request_id': 'req-4ee9a71f-e030-40ce-9a62-60f4bcac5167'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.654583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] The token cache is being invalidate because project edd573977cb64f70b39b2ef5d1ed1cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:46:01.654864 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.655575 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.657154 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1404/2804] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:46:01 2022] DELETE /identity/v3/projects/edd573977cb64f70b39b2ef5d1ed1cb7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:46:01.661395 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:46:01.663086 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:46:01.677166 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddd7a-38a4-4b1a-9f11-0b4cf85251a4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:46:01.737161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:46:01.737858 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:46:01.738133 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:46:01.738406 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] PATH_INFO: `/v3/users/8473f3f014e44afcba4b30ab6f674447` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:46:01.739553 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8473f3f014e44afcba4b30ab6f674447)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:46:01.741483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:46:01.789910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8473f3f014e44afcba4b30ab6f674447'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.790612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8473f3f014e44afcba4b30ab6f674447'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.799128 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8473f3f014e44afcba4b30ab6f674447'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.806549 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8473f3f014e44afcba4b30ab6f674447'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.807189 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-67612076-c250-4ee3-a958-5d2725e2c247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8473f3f014e44afcba4b30ab6f674447'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:01.815799 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:46:01.827248 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1401/2805] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:46:01 2022] DELETE /identity/v3/users/8473f3f014e44afcba4b30ab6f674447 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:46:02.009491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:46:02.011243 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:46:02.025195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9a71f-e030-40ce-9a62-60f4bcac5167 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:46:02.084073 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:46:02.084702 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:46:02.084975 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:46:02.085245 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] PATH_INFO: `/v3/projects/cf9c1f195a7d494698042770b6ae0a02` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:46:02.086404 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf9c1f195a7d494698042770b6ae0a02)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:46:02.088301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:46:02.136270 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf9c1f195a7d494698042770b6ae0a02', 'request_id': 'req-75ac2060-61e6-4580-88af-9f8eed87d4ee'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:02.142281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf9c1f195a7d494698042770b6ae0a02', 'request_id': 'req-75ac2060-61e6-4580-88af-9f8eed87d4ee'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:02.152485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf9c1f195a7d494698042770b6ae0a02', 'request_id': 'req-75ac2060-61e6-4580-88af-9f8eed87d4ee'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:02.163185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] The token cache is being invalidate because project cf9c1f195a7d494698042770b6ae0a02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:46:02.163469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:02.164100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:46:02.165590 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1405/2806] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:46:02 2022] DELETE /identity/v3/projects/cf9c1f195a7d494698042770b6ae0a02 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:46:11.826838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:46:12.160618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:46:26.203465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698aea9-d3ab-483a-9eae-f940e81ca214 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:46:26.203960 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698aea9-d3ab-483a-9eae-f940e81ca214 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:46:26.204080 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698aea9-d3ab-483a-9eae-f940e81ca214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:46:26.224411 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e698aea9-d3ab-483a-9eae-f940e81ca214 None None] MFA Rules not processed for user `8f119e7a0b66415ab88cd641886c2e82`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:46:26.225680 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e698aea9-d3ab-483a-9eae-f940e81ca214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:46:26.285637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1402/2807] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:46:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:46:36.277670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=25 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:12.767306 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:12.768795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:12.849465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac2060-61e6-4580-88af-9f8eed87d4ee admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:12.853574 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:12.854201 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:12.854477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:12.854744 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:12.856650 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:12.934256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:12.935695 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:12.946997 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1406/2808] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:15.616251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698aea9-d3ab-483a-9eae-f940e81ca214 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:15.617921 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e698aea9-d3ab-483a-9eae-f940e81ca214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:15.631151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698aea9-d3ab-483a-9eae-f940e81ca214 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:15.635489 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:15.636092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:15.636365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:15.636637 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:15.638721 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:15.653079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:15.654850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:15.666300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1403/2809] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:22.942231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=63 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:25.660981 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:28.410853 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:28.412357 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:28.478438 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc17e5a5-8a4b-4050-96e6-a87638f86dfc service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:28.482941 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:28.483556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:28.483828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:28.484094 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] PATH_INFO: `/v3/users/8f119e7a0b66415ab88cd641886c2e82` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:28.485189 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f119e7a0b66415ab88cd641886c2e82)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:28.487132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:28.535735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f119e7a0b66415ab88cd641886c2e82'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.536371 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f119e7a0b66415ab88cd641886c2e82'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.544526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f119e7a0b66415ab88cd641886c2e82'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.558459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f119e7a0b66415ab88cd641886c2e82'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.559376 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-f0f8f8f2-f8e2-4999-861b-0f9d09c26775 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f119e7a0b66415ab88cd641886c2e82'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.574269 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1407/2810] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:47:28 2022] DELETE /identity/v3/users/8f119e7a0b66415ab88cd641886c2e82 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:28.744709 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:28.756802 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1dca4-6c25-476d-9e90-cf4acc1f111c service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:28.817437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:28.818161 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:28.818445 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:28.818707 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] PATH_INFO: `/v3/projects/41e6e18961a7409a8014d832de70d299` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:28.819819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e6e18961a7409a8014d832de70d299)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:28.821919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:28.869738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e6e18961a7409a8014d832de70d299', 'request_id': 'req-919813c2-e3a0-4caf-adcb-f39a558bbd5c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.875504 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e6e18961a7409a8014d832de70d299', 'request_id': 'req-919813c2-e3a0-4caf-adcb-f39a558bbd5c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.882119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e6e18961a7409a8014d832de70d299', 'request_id': 'req-919813c2-e3a0-4caf-adcb-f39a558bbd5c'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.895668 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] The token cache is being invalidate because project 41e6e18961a7409a8014d832de70d299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:47:28.895970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.896590 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-919813c2-e3a0-4caf-adcb-f39a558bbd5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:28.898127 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1404/2811] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:47:28 2022] DELETE /identity/v3/projects/41e6e18961a7409a8014d832de70d299 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:28.903195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739ab24-8389-4892-bb4e-11ba47385f4c None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:28.903532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739ab24-8389-4892-bb4e-11ba47385f4c None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:28.903835 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739ab24-8389-4892-bb4e-11ba47385f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:28.924716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3739ab24-8389-4892-bb4e-11ba47385f4c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:28.925962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3739ab24-8389-4892-bb4e-11ba47385f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:28.990109 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1408/2812] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:28.998008 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5597-b3e6-4760-b7f4-7d8d7c51acad None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:28.998291 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5597-b3e6-4760-b7f4-7d8d7c51acad None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:28.998567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff5597-b3e6-4760-b7f4-7d8d7c51acad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.019265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-dbff5597-b3e6-4760-b7f4-7d8d7c51acad None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:29.020462 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-dbff5597-b3e6-4760-b7f4-7d8d7c51acad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:29.028905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1405/2813] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:29.033293 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739ab24-8389-4892-bb4e-11ba47385f4c None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.043534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739ab24-8389-4892-bb4e-11ba47385f4c None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.049256 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.049912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.050183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.050449 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.051095 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:47:29.051391 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.053005 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.064675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1409/2814] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:47:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:47:29.069106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff5597-b3e6-4760-b7f4-7d8d7c51acad None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.079065 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff5597-b3e6-4760-b7f4-7d8d7c51acad None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.084300 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73837a8a-ad0a-4a3f-9aa6-403b0fef3066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.084884 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73837a8a-ad0a-4a3f-9aa6-403b0fef3066 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.085167 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73837a8a-ad0a-4a3f-9aa6-403b0fef3066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.085430 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73837a8a-ad0a-4a3f-9aa6-403b0fef3066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.086090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73837a8a-ad0a-4a3f-9aa6-403b0fef3066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.087982 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73837a8a-ad0a-4a3f-9aa6-403b0fef3066 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.131564 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1406/2815] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:29 2022] POST /identity/v3/projects => generated 357 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:29.135827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.146528 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534d201-fce3-4620-bae3-9a49623d2b14 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.150301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:29.206311 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0fb2c-3ad5-4496-bd4d-328e7fcfbfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.206944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0fb2c-3ad5-4496-bd4d-328e7fcfbfd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.207229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0fb2c-3ad5-4496-bd4d-328e7fcfbfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.207503 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b0fb2c-3ad5-4496-bd4d-328e7fcfbfd6 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.208134 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0fb2c-3ad5-4496-bd4d-328e7fcfbfd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.210079 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b0fb2c-3ad5-4496-bd4d-328e7fcfbfd6 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.235621 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1410/2816] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:29 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:29.236826 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73837a8a-ad0a-4a3f-9aa6-403b0fef3066 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.247204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73837a8a-ad0a-4a3f-9aa6-403b0fef3066 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.252119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c88a51-0538-43af-bf6a-07965184fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.252719 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c88a51-0538-43af-bf6a-07965184fb17 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.252996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c88a51-0538-43af-bf6a-07965184fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.253263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c88a51-0538-43af-bf6a-07965184fb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.253970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c88a51-0538-43af-bf6a-07965184fb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.255931 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c88a51-0538-43af-bf6a-07965184fb17 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.265776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1407/2817] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:29.269992 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0fb2c-3ad5-4496-bd4d-328e7fcfbfd6 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.279860 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b0fb2c-3ad5-4496-bd4d-328e7fcfbfd6 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.284474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357f3d8-eb82-4a6c-bc13-b93067d116e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.285106 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f3d8-eb82-4a6c-bc13-b93067d116e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.285370 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f3d8-eb82-4a6c-bc13-b93067d116e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.285635 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357f3d8-eb82-4a6c-bc13-b93067d116e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.286297 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f3d8-eb82-4a6c-bc13-b93067d116e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.287877 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357f3d8-eb82-4a6c-bc13-b93067d116e8 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.298915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1411/2818] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:47:29.303339 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c88a51-0538-43af-bf6a-07965184fb17 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.313726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c88a51-0538-43af-bf6a-07965184fb17 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.319609 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37993ac8-66d5-4c64-95b0-703f85dc3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.320260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993ac8-66d5-4c64-95b0-703f85dc3fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.320538 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993ac8-66d5-4c64-95b0-703f85dc3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.320807 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37993ac8-66d5-4c64-95b0-703f85dc3fdb admin admin] PATH_INFO: `/v3/projects/5ba66062803546f48dbbaa592ca6c836/users/b5ea51662fb446e9ab60efb795647417/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.336594 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37993ac8-66d5-4c64-95b0-703f85dc3fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ba66062803546f48dbbaa592ca6c836, user_id=b5ea51662fb446e9ab60efb795647417, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.339342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37993ac8-66d5-4c64-95b0-703f85dc3fdb admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.355507 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1408/2819] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:29 2022] PUT /identity/v3/projects/5ba66062803546f48dbbaa592ca6c836/users/b5ea51662fb446e9ab60efb795647417/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:29.369409 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fe6b-ea95-4fa1-8475-5afc8312e441 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.369889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fe6b-ea95-4fa1-8475-5afc8312e441 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.370178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6fe6b-ea95-4fa1-8475-5afc8312e441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.400313 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-39c6fe6b-ea95-4fa1-8475-5afc8312e441 None None] MFA Rules not processed for user `b5ea51662fb446e9ab60efb795647417`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:29.401515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-39c6fe6b-ea95-4fa1-8475-5afc8312e441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:29.468111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1412/2820] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:29.473912 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37993ac8-66d5-4c64-95b0-703f85dc3fdb admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.494510 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:29.540223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37993ac8-66d5-4c64-95b0-703f85dc3fdb admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.545885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99abc-9eda-4dcc-bf6e-8ae043d92929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.546495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99abc-9eda-4dcc-bf6e-8ae043d92929 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.546776 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99abc-9eda-4dcc-bf6e-8ae043d92929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.547070 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde99abc-9eda-4dcc-bf6e-8ae043d92929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.547698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde99abc-9eda-4dcc-bf6e-8ae043d92929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.549627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde99abc-9eda-4dcc-bf6e-8ae043d92929 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.579068 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1409/2821] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:29 2022] POST /identity/v3/projects => generated 357 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:29.583232 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6fe6b-ea95-4fa1-8475-5afc8312e441 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.594843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6fe6b-ea95-4fa1-8475-5afc8312e441 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.652910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecb540-b1b1-4cd9-940f-40c02612997b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.653519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecb540-b1b1-4cd9-940f-40c02612997b admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.653825 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecb540-b1b1-4cd9-940f-40c02612997b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.654100 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecb540-b1b1-4cd9-940f-40c02612997b admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.654735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecb540-b1b1-4cd9-940f-40c02612997b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.656690 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecb540-b1b1-4cd9-940f-40c02612997b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.678601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1413/2822] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:29 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:29.682816 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99abc-9eda-4dcc-bf6e-8ae043d92929 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.692898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde99abc-9eda-4dcc-bf6e-8ae043d92929 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.697657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c21c3-21c6-49d8-a0c2-f004bf5644ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.698272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c21c3-21c6-49d8-a0c2-f004bf5644ed admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.698544 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c21c3-21c6-49d8-a0c2-f004bf5644ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.698806 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c21c3-21c6-49d8-a0c2-f004bf5644ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.699438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c21c3-21c6-49d8-a0c2-f004bf5644ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.701295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189c21c3-21c6-49d8-a0c2-f004bf5644ed admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.711745 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1410/2823] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:29.715916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecb540-b1b1-4cd9-940f-40c02612997b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.722510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:29.726407 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecb540-b1b1-4cd9-940f-40c02612997b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.732558 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ebce-562a-4b93-ae2f-7f24088aa6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.733227 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ebce-562a-4b93-ae2f-7f24088aa6f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.733496 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ebce-562a-4b93-ae2f-7f24088aa6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.733783 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46ebce-562a-4b93-ae2f-7f24088aa6f1 admin admin] PATH_INFO: `/v3/projects/c82c0ab2f62d4a28a5060bff1932542e/users/06d97ff5db0c4ca599381d4a0b97d86a/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.749457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46ebce-562a-4b93-ae2f-7f24088aa6f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82c0ab2f62d4a28a5060bff1932542e, user_id=06d97ff5db0c4ca599381d4a0b97d86a, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.752137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f46ebce-562a-4b93-ae2f-7f24088aa6f1 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.766472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1414/2824] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:29 2022] PUT /identity/v3/projects/c82c0ab2f62d4a28a5060bff1932542e/users/06d97ff5db0c4ca599381d4a0b97d86a/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:29.770634 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c21c3-21c6-49d8-a0c2-f004bf5644ed admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.780688 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c21c3-21c6-49d8-a0c2-f004bf5644ed admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.839952 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56356d36-add1-4ac8-b309-59c16700fbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.840560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56356d36-add1-4ac8-b309-59c16700fbcd admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.840840 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56356d36-add1-4ac8-b309-59c16700fbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.841110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56356d36-add1-4ac8-b309-59c16700fbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.841741 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56356d36-add1-4ac8-b309-59c16700fbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.843438 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56356d36-add1-4ac8-b309-59c16700fbcd admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.853664 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1411/2825] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:29 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:47:29.857973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ebce-562a-4b93-ae2f-7f24088aa6f1 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:29.868482 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46ebce-562a-4b93-ae2f-7f24088aa6f1 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:29.873564 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:29.874364 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.874643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.874913 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] PATH_INFO: `/v3/projects/c82c0ab2f62d4a28a5060bff1932542e/users/06d97ff5db0c4ca599381d4a0b97d86a/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.876901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82c0ab2f62d4a28a5060bff1932542e, user_id=06d97ff5db0c4ca599381d4a0b97d86a, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:29.880017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:29.890712 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1415/2826] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:29 2022] PUT /identity/v3/projects/c82c0ab2f62d4a28a5060bff1932542e/users/06d97ff5db0c4ca599381d4a0b97d86a/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:29.901450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec466a-0458-4632-88ca-07c48eacd58e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:29.901736 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec466a-0458-4632-88ca-07c48eacd58e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:29.902050 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec466a-0458-4632-88ca-07c48eacd58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:29.930400 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-48ec466a-0458-4632-88ca-07c48eacd58e None None] MFA Rules not processed for user `06d97ff5db0c4ca599381d4a0b97d86a`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:29.931616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-48ec466a-0458-4632-88ca-07c48eacd58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:30.003726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1412/2827] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:30.015633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:30.017434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:30.076105 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3dad-118b-4ff3-9bea-124f2b4e4547 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:30.080475 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f6a5-0f4c-49e2-bdf7-892b104c90c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:30.081052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f6a5-0f4c-49e2-bdf7-892b104c90c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:30.081356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f6a5-0f4c-49e2-bdf7-892b104c90c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:30.081668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677f6a5-0f4c-49e2-bdf7-892b104c90c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:30.091013 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677f6a5-0f4c-49e2-bdf7-892b104c90c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:30.092459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677f6a5-0f4c-49e2-bdf7-892b104c90c2 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:30.102111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1416/2828] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:30 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:30.185313 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec466a-0458-4632-88ca-07c48eacd58e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:30.195252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec466a-0458-4632-88ca-07c48eacd58e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:30.198961 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2c037-2631-4f93-8d4c-a9705068eb00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:30.199557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c037-2631-4f93-8d4c-a9705068eb00 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:30.199837 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c037-2631-4f93-8d4c-a9705068eb00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:30.200106 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2c037-2631-4f93-8d4c-a9705068eb00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:30.209901 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:30.259629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2c037-2631-4f93-8d4c-a9705068eb00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:30.261120 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef2c037-2631-4f93-8d4c-a9705068eb00 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:30.270108 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1413/2829] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:40.097798 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:40.266115 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=22 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:45.360859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f6a5-0f4c-49e2-bdf7-892b104c90c2 service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:45.424879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677f6a5-0f4c-49e2-bdf7-892b104c90c2 service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:45.430254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:45.430879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:45.431152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:45.431412 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] PATH_INFO: `/v3/users/b5ea51662fb446e9ab60efb795647417` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:45.432619 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ea51662fb446e9ab60efb795647417)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:45.434671 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:45.485457 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ea51662fb446e9ab60efb795647417'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:45.486143 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ea51662fb446e9ab60efb795647417'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:45.494580 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ea51662fb446e9ab60efb795647417'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:45.507197 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ea51662fb446e9ab60efb795647417'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:45.507880 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ea51662fb446e9ab60efb795647417'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:45.520301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1417/2830] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:47:45 2022] DELETE /identity/v3/users/b5ea51662fb446e9ab60efb795647417 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:45.525092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b550a6f-a88b-4b37-9878-651683f0e2da None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:45.525625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b550a6f-a88b-4b37-9878-651683f0e2da None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:45.525625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b550a6f-a88b-4b37-9878-651683f0e2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:45.545796 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-3b550a6f-a88b-4b37-9878-651683f0e2da None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:45.547003 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3b550a6f-a88b-4b37-9878-651683f0e2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:45.607869 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1414/2831] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:45.618014 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:45.619533 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:45.679200 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad91462-c8f4-417b-9737-75358cb5e99d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:45.684020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63d4c2-9019-4bc3-b276-bd93683dddf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:45.684626 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d4c2-9019-4bc3-b276-bd93683dddf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:45.684899 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d4c2-9019-4bc3-b276-bd93683dddf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:45.685163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63d4c2-9019-4bc3-b276-bd93683dddf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:45.695560 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63d4c2-9019-4bc3-b276-bd93683dddf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:45.697016 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63d4c2-9019-4bc3-b276-bd93683dddf7 service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:45.706827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1418/2832] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:45.987141 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b550a6f-a88b-4b37-9878-651683f0e2da None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:45.989440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-3b550a6f-a88b-4b37-9878-651683f0e2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:46.002399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b550a6f-a88b-4b37-9878-651683f0e2da None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:46.007496 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:46.008134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:46.008420 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:46.008691 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] PATH_INFO: `/v3/projects/5ba66062803546f48dbbaa592ca6c836` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:46.009875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ba66062803546f48dbbaa592ca6c836)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:46.011881 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:46.059829 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ba66062803546f48dbbaa592ca6c836', 'request_id': 'req-65ec855f-4512-4f0b-a82b-811c618dd7a1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.065875 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ba66062803546f48dbbaa592ca6c836', 'request_id': 'req-65ec855f-4512-4f0b-a82b-811c618dd7a1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.072308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ba66062803546f48dbbaa592ca6c836', 'request_id': 'req-65ec855f-4512-4f0b-a82b-811c618dd7a1'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.086966 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] The token cache is being invalidate because project 5ba66062803546f48dbbaa592ca6c836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:47:46.087260 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.087885 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.089372 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1415/2833] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:47:45 2022] DELETE /identity/v3/projects/5ba66062803546f48dbbaa592ca6c836 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:46.093893 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63d4c2-9019-4bc3-b276-bd93683dddf7 service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:46.103437 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63d4c2-9019-4bc3-b276-bd93683dddf7 service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:46.122055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:46.162840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:46.163459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:46.163735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:46.164004 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] PATH_INFO: `/v3/users/06d97ff5db0c4ca599381d4a0b97d86a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:46.165155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d97ff5db0c4ca599381d4a0b97d86a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:46.167115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:46.216870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d97ff5db0c4ca599381d4a0b97d86a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.217502 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d97ff5db0c4ca599381d4a0b97d86a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.225585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d97ff5db0c4ca599381d4a0b97d86a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.237399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d97ff5db0c4ca599381d4a0b97d86a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.238054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-9834c77d-08f7-435a-b93f-6c1a694617f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d97ff5db0c4ca599381d4a0b97d86a'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.250250 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1419/2834] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:47:46 2022] DELETE /identity/v3/users/06d97ff5db0c4ca599381d4a0b97d86a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:46.518905 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:46.520458 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:46.534383 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ec855f-4512-4f0b-a82b-811c618dd7a1 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:46.592740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:46.593289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:46.593566 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:46.593864 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] PATH_INFO: `/v3/projects/c82c0ab2f62d4a28a5060bff1932542e` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:46.594962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82c0ab2f62d4a28a5060bff1932542e)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:46.596877 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:46.628726 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:46.646621 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82c0ab2f62d4a28a5060bff1932542e', 'request_id': 'req-1e3d0f3f-d609-470d-bf96-306e317b6c36'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.652197 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82c0ab2f62d4a28a5060bff1932542e', 'request_id': 'req-1e3d0f3f-d609-470d-bf96-306e317b6c36'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.658244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82c0ab2f62d4a28a5060bff1932542e', 'request_id': 'req-1e3d0f3f-d609-470d-bf96-306e317b6c36'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.672655 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] The token cache is being invalidate because project c82c0ab2f62d4a28a5060bff1932542e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:47:46.672976 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.673585 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-1e3d0f3f-d609-470d-bf96-306e317b6c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:46.675082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1416/2835] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:47:46 2022] DELETE /identity/v3/projects/c82c0ab2f62d4a28a5060bff1932542e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:46.680183 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8233-c0d7-4d40-8f6d-2484a8063d33 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:46.680696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8233-c0d7-4d40-8f6d-2484a8063d33 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:46.680696 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd8233-c0d7-4d40-8f6d-2484a8063d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:46.700556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-4bbd8233-c0d7-4d40-8f6d-2484a8063d33 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:46.701855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4bbd8233-c0d7-4d40-8f6d-2484a8063d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:46.761980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1420/2836] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:46.771412 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a679ec-e9c1-4e70-99f0-e4cffaa1f04c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:46.771699 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a679ec-e9c1-4e70-99f0-e4cffaa1f04c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:46.771995 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a679ec-e9c1-4e70-99f0-e4cffaa1f04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:46.793202 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-f6a679ec-e9c1-4e70-99f0-e4cffaa1f04c None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:46.794436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-f6a679ec-e9c1-4e70-99f0-e4cffaa1f04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:46.804381 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1417/2837] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:46.808805 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd8233-c0d7-4d40-8f6d-2484a8063d33 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:46.819103 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd8233-c0d7-4d40-8f6d-2484a8063d33 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:46.825613 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:46.826275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:46.826530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:46.826791 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:46.827431 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:47:46.827734 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:46.829314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:46.841607 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1421/2838] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:47:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:47:46.846022 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a679ec-e9c1-4e70-99f0-e4cffaa1f04c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:46.855591 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a679ec-e9c1-4e70-99f0-e4cffaa1f04c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:46.861649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730be1f-42f1-4b10-bb6e-2a66efcb0f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:46.862377 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730be1f-42f1-4b10-bb6e-2a66efcb0f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:46.862650 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730be1f-42f1-4b10-bb6e-2a66efcb0f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:46.862928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730be1f-42f1-4b10-bb6e-2a66efcb0f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:46.863582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730be1f-42f1-4b10-bb6e-2a66efcb0f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:46.865483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730be1f-42f1-4b10-bb6e-2a66efcb0f37 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:46.896294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1418/2839] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:46 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:46.901241 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:46.912485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732eb32-c499-4637-80a8-d9a00e2ca852 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:46.939162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:46.971672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd4150-f2fa-432d-8cd2-972e3b944018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:46.972275 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd4150-f2fa-432d-8cd2-972e3b944018 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:46.972551 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd4150-f2fa-432d-8cd2-972e3b944018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:46.972822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd4150-f2fa-432d-8cd2-972e3b944018 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:46.973459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd4150-f2fa-432d-8cd2-972e3b944018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:46.975469 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd4150-f2fa-432d-8cd2-972e3b944018 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.001611 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1422/2840] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:46 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:47:47.006264 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730be1f-42f1-4b10-bb6e-2a66efcb0f37 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.017315 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730be1f-42f1-4b10-bb6e-2a66efcb0f37 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.022835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f17c7e-2ad9-4cbe-bec0-a683ae46c310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.023416 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f17c7e-2ad9-4cbe-bec0-a683ae46c310 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.023697 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f17c7e-2ad9-4cbe-bec0-a683ae46c310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.023972 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f17c7e-2ad9-4cbe-bec0-a683ae46c310 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.024616 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f17c7e-2ad9-4cbe-bec0-a683ae46c310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.026278 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f17c7e-2ad9-4cbe-bec0-a683ae46c310 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.036356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1419/2841] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:47.040253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd4150-f2fa-432d-8cd2-972e3b944018 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.050603 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd4150-f2fa-432d-8cd2-972e3b944018 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.056378 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ad016-58f1-4b99-af45-f2e2f33cb4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.056950 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad016-58f1-4b99-af45-f2e2f33cb4ff admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.057222 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad016-58f1-4b99-af45-f2e2f33cb4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.057483 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ad016-58f1-4b99-af45-f2e2f33cb4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.058155 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ad016-58f1-4b99-af45-f2e2f33cb4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.059748 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ad016-58f1-4b99-af45-f2e2f33cb4ff admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.070539 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1423/2842] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:47.074729 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f17c7e-2ad9-4cbe-bec0-a683ae46c310 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.085369 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f17c7e-2ad9-4cbe-bec0-a683ae46c310 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.091318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac8228-f2b9-4d61-a795-1617a85e1c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.092036 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac8228-f2b9-4d61-a795-1617a85e1c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.092317 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac8228-f2b9-4d61-a795-1617a85e1c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.092586 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac8228-f2b9-4d61-a795-1617a85e1c19 admin admin] PATH_INFO: `/v3/projects/3dfe97be04a04676a007c5173519c9c2/users/2e923aeefbc343ad8d20d18a50e84b67/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.108589 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac8228-f2b9-4d61-a795-1617a85e1c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfe97be04a04676a007c5173519c9c2, user_id=2e923aeefbc343ad8d20d18a50e84b67, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.111238 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbac8228-f2b9-4d61-a795-1617a85e1c19 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.126694 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1420/2843] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:47 2022] PUT /identity/v3/projects/3dfe97be04a04676a007c5173519c9c2/users/2e923aeefbc343ad8d20d18a50e84b67/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:47:47.137530 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdceb4b-acf6-4dc3-be9c-9a77f79dda5d None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.137848 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdceb4b-acf6-4dc3-be9c-9a77f79dda5d None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.138120 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdceb4b-acf6-4dc3-be9c-9a77f79dda5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.168127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8bdceb4b-acf6-4dc3-be9c-9a77f79dda5d None None] MFA Rules not processed for user `2e923aeefbc343ad8d20d18a50e84b67`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:47.169348 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8bdceb4b-acf6-4dc3-be9c-9a77f79dda5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:47.245247 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1424/2844] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:47.250049 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac8228-f2b9-4d61-a795-1617a85e1c19 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.313550 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac8228-f2b9-4d61-a795-1617a85e1c19 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.318670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41eab2-2fb2-4aaf-9b35-46d82a3f3766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.319270 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41eab2-2fb2-4aaf-9b35-46d82a3f3766 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.319535 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41eab2-2fb2-4aaf-9b35-46d82a3f3766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.319819 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41eab2-2fb2-4aaf-9b35-46d82a3f3766 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.320440 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41eab2-2fb2-4aaf-9b35-46d82a3f3766 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.322380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc41eab2-2fb2-4aaf-9b35-46d82a3f3766 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.350949 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1421/2845] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:47 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:47.355663 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdceb4b-acf6-4dc3-be9c-9a77f79dda5d None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.367190 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdceb4b-acf6-4dc3-be9c-9a77f79dda5d None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.429135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72d2b7-60a8-4a83-82ee-3c11ea07029d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.429802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d2b7-60a8-4a83-82ee-3c11ea07029d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.430085 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d2b7-60a8-4a83-82ee-3c11ea07029d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.430360 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72d2b7-60a8-4a83-82ee-3c11ea07029d admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.431024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72d2b7-60a8-4a83-82ee-3c11ea07029d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.432964 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c72d2b7-60a8-4a83-82ee-3c11ea07029d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.455047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1425/2846] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:47 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:47.459191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41eab2-2fb2-4aaf-9b35-46d82a3f3766 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.469710 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41eab2-2fb2-4aaf-9b35-46d82a3f3766 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.474630 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d9252-b88e-4b60-8c99-d31d909b4e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.475229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9252-b88e-4b60-8c99-d31d909b4e4e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.475524 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9252-b88e-4b60-8c99-d31d909b4e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.475793 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d9252-b88e-4b60-8c99-d31d909b4e4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.476431 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d9252-b88e-4b60-8c99-d31d909b4e4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.478058 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554d9252-b88e-4b60-8c99-d31d909b4e4e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.488759 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1422/2847] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:47.493249 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72d2b7-60a8-4a83-82ee-3c11ea07029d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.509735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72d2b7-60a8-4a83-82ee-3c11ea07029d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.516642 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04e4bf-aa68-4026-9f2f-ab62b513df76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.517328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e4bf-aa68-4026-9f2f-ab62b513df76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.517586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e4bf-aa68-4026-9f2f-ab62b513df76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.517878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04e4bf-aa68-4026-9f2f-ab62b513df76 admin admin] PATH_INFO: `/v3/projects/53d447c128324833b71180f1f4cd83bf/users/73aecc0c40e74b219c9ce201784bc087/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.533961 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04e4bf-aa68-4026-9f2f-ab62b513df76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d447c128324833b71180f1f4cd83bf, user_id=73aecc0c40e74b219c9ce201784bc087, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.536743 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04e4bf-aa68-4026-9f2f-ab62b513df76 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.551520 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1426/2848] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:47 2022] PUT /identity/v3/projects/53d447c128324833b71180f1f4cd83bf/users/73aecc0c40e74b219c9ce201784bc087/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:47.555644 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d9252-b88e-4b60-8c99-d31d909b4e4e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.566174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d9252-b88e-4b60-8c99-d31d909b4e4e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.586134 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:47.625666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94676260-e861-4f27-acc7-05e16d108c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.626259 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676260-e861-4f27-acc7-05e16d108c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.626518 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676260-e861-4f27-acc7-05e16d108c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.626795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94676260-e861-4f27-acc7-05e16d108c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.627437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94676260-e861-4f27-acc7-05e16d108c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.629367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94676260-e861-4f27-acc7-05e16d108c86 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.640358 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1423/2849] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:47.645953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04e4bf-aa68-4026-9f2f-ab62b513df76 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.651921 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:47.658894 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04e4bf-aa68-4026-9f2f-ab62b513df76 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.663846 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.664490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.664768 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.665042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] PATH_INFO: `/v3/projects/53d447c128324833b71180f1f4cd83bf/users/73aecc0c40e74b219c9ce201784bc087/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.666988 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] RBAC: Authorizing `identity:create_grant(project_id=53d447c128324833b71180f1f4cd83bf, user_id=73aecc0c40e74b219c9ce201784bc087, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.669778 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.680480 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1427/2850] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:47 2022] PUT /identity/v3/projects/53d447c128324833b71180f1f4cd83bf/users/73aecc0c40e74b219c9ce201784bc087/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:47.692092 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2c4e-ae7c-4100-a533-ce4065a3461c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.692378 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2c4e-ae7c-4100-a533-ce4065a3461c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.692653 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e2c4e-ae7c-4100-a533-ce4065a3461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.720975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-608e2c4e-ae7c-4100-a533-ce4065a3461c None None] MFA Rules not processed for user `73aecc0c40e74b219c9ce201784bc087`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:47.722229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-608e2c4e-ae7c-4100-a533-ce4065a3461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:47.792196 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1424/2851] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:47 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:47:47.803819 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.805785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:47.866356 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5168f3-c9ab-4449-a978-d71592a8612f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.871307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475b351-8013-4d98-bb24-cd30aa9488bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.871910 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b351-8013-4d98-bb24-cd30aa9488bc service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.872178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b351-8013-4d98-bb24-cd30aa9488bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.872424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475b351-8013-4d98-bb24-cd30aa9488bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.883163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475b351-8013-4d98-bb24-cd30aa9488bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.884870 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475b351-8013-4d98-bb24-cd30aa9488bc service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:47.894711 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1428/2852] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:47 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:47.925288 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e2c4e-ae7c-4100-a533-ce4065a3461c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:47.989263 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e2c4e-ae7c-4100-a533-ce4065a3461c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:47.994004 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:47.994638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:47.994916 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:47.995191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] PATH_INFO: `/v3/users/2e923aeefbc343ad8d20d18a50e84b67` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:47.996356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e923aeefbc343ad8d20d18a50e84b67)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:47.998379 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:48.047882 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e923aeefbc343ad8d20d18a50e84b67'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.048529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e923aeefbc343ad8d20d18a50e84b67'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.050216 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:48.056738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e923aeefbc343ad8d20d18a50e84b67'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.063953 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e923aeefbc343ad8d20d18a50e84b67'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.064582 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e923aeefbc343ad8d20d18a50e84b67'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.081529 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1425/2853] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:47:47 2022] DELETE /identity/v3/users/2e923aeefbc343ad8d20d18a50e84b67 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:48.086254 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288fa1a-f482-40a5-99a3-517ceab7976a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:48.086537 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288fa1a-f482-40a5-99a3-517ceab7976a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:48.086840 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288fa1a-f482-40a5-99a3-517ceab7976a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:48.106649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-6288fa1a-f482-40a5-99a3-517ceab7976a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:48.107944 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6288fa1a-f482-40a5-99a3-517ceab7976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:48.166362 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1429/2854] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:48.177880 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:48.179547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:48.241738 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0cd63-5019-4778-b35d-d9dc8c27b470 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:48.248331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424c75-0a28-4456-a1a9-b711f97cdb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:48.249244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424c75-0a28-4456-a1a9-b711f97cdb09 service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:48.249567 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424c75-0a28-4456-a1a9-b711f97cdb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:48.249925 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57424c75-0a28-4456-a1a9-b711f97cdb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:48.264569 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57424c75-0a28-4456-a1a9-b711f97cdb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:48.266061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57424c75-0a28-4456-a1a9-b711f97cdb09 service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:48.276547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1426/2855] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:48.571163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288fa1a-f482-40a5-99a3-517ceab7976a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:48.572652 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-6288fa1a-f482-40a5-99a3-517ceab7976a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:48.588305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6288fa1a-f482-40a5-99a3-517ceab7976a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:48.593888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:48.594655 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:48.595649 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:48.596335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] PATH_INFO: `/v3/projects/3dfe97be04a04676a007c5173519c9c2` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:48.597803 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfe97be04a04676a007c5173519c9c2)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:48.600609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:48.649509 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfe97be04a04676a007c5173519c9c2', 'request_id': 'req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.655942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfe97be04a04676a007c5173519c9c2', 'request_id': 'req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.664443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfe97be04a04676a007c5173519c9c2', 'request_id': 'req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.675554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] The token cache is being invalidate because project 3dfe97be04a04676a007c5173519c9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:47:48.675872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.676534 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.678083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1430/2856] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:47:48 2022] DELETE /identity/v3/projects/3dfe97be04a04676a007c5173519c9c2 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:48.682262 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424c75-0a28-4456-a1a9-b711f97cdb09 service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:48.692279 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57424c75-0a28-4456-a1a9-b711f97cdb09 service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:48.750011 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:48.750645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:48.750910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:48.751178 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] PATH_INFO: `/v3/users/73aecc0c40e74b219c9ce201784bc087` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:48.752350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=73aecc0c40e74b219c9ce201784bc087)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:48.754735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:48.804689 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73aecc0c40e74b219c9ce201784bc087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.805359 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73aecc0c40e74b219c9ce201784bc087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.813521 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73aecc0c40e74b219c9ce201784bc087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.820380 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73aecc0c40e74b219c9ce201784bc087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.821052 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-3d3e5e3e-55ac-4d2a-ad19-4f188b56bf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73aecc0c40e74b219c9ce201784bc087'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:48.826284 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:48.840182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1427/2857] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:47:48 2022] DELETE /identity/v3/users/73aecc0c40e74b219c9ce201784bc087 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:49.136112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:49.137664 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:49.154477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97e4ea-6bb5-4659-9879-cd2cd37c5bd2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:49.167993 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:49.216799 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:49.217400 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.217675 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.217973 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] PATH_INFO: `/v3/projects/53d447c128324833b71180f1f4cd83bf` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.219191 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53d447c128324833b71180f1f4cd83bf)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:49.221097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:49.273641 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d447c128324833b71180f1f4cd83bf', 'request_id': 'req-51befb5b-ec0e-42f3-add9-ed4d4471e580'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:49.281345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d447c128324833b71180f1f4cd83bf', 'request_id': 'req-51befb5b-ec0e-42f3-add9-ed4d4471e580'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:49.290994 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d447c128324833b71180f1f4cd83bf', 'request_id': 'req-51befb5b-ec0e-42f3-add9-ed4d4471e580'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:49.302039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] The token cache is being invalidate because project 53d447c128324833b71180f1f4cd83bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:47:49.302328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:49.302956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-51befb5b-ec0e-42f3-add9-ed4d4471e580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:49.304443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1431/2858] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:47:49 2022] DELETE /identity/v3/projects/53d447c128324833b71180f1f4cd83bf => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:49.309513 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75801-3d86-42d7-8f58-9a673db056b3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.309778 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75801-3d86-42d7-8f58-9a673db056b3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.310110 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd75801-3d86-42d7-8f58-9a673db056b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.331727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1bd75801-3d86-42d7-8f58-9a673db056b3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:49.332944 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1bd75801-3d86-42d7-8f58-9a673db056b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:49.407980 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1428/2859] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:47:49.415999 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e7782-0559-4b72-9307-03aac775cf36 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.416283 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e7782-0559-4b72-9307-03aac775cf36 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.416555 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e7782-0559-4b72-9307-03aac775cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.438303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-082e7782-0559-4b72-9307-03aac775cf36 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:49.439550 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-082e7782-0559-4b72-9307-03aac775cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:49.447855 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1432/2860] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:49.452151 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd75801-3d86-42d7-8f58-9a673db056b3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:49.462067 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd75801-3d86-42d7-8f58-9a673db056b3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:49.466914 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:49.467545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.467821 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.468090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.468734 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:47:49.469033 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:49.470669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:49.482348 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1429/2861] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:47:49.487070 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e7782-0559-4b72-9307-03aac775cf36 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:49.501881 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e7782-0559-4b72-9307-03aac775cf36 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:49.510939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc511a-6fb8-459e-b433-7992c8f9a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:49.511806 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc511a-6fb8-459e-b433-7992c8f9a01e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.512127 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc511a-6fb8-459e-b433-7992c8f9a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.512476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc511a-6fb8-459e-b433-7992c8f9a01e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.513403 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc511a-6fb8-459e-b433-7992c8f9a01e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:49.515606 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc511a-6fb8-459e-b433-7992c8f9a01e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:49.547223 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1433/2862] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:49 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:47:49.551477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:49.562627 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1382e6-a3ee-4e72-aa4f-5003e31e8cb4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:49.620399 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a4112-8b90-4c45-ba26-97c6f7d1c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:49.621069 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4112-8b90-4c45-ba26-97c6f7d1c035 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.621357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4112-8b90-4c45-ba26-97c6f7d1c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.621624 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a4112-8b90-4c45-ba26-97c6f7d1c035 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.622289 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a4112-8b90-4c45-ba26-97c6f7d1c035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:49.624191 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a4112-8b90-4c45-ba26-97c6f7d1c035 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:49.646533 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1430/2863] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:49 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:49.650733 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc511a-6fb8-459e-b433-7992c8f9a01e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:49.660956 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc511a-6fb8-459e-b433-7992c8f9a01e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:49.665876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd89f71-b9d9-4128-ba8a-9439c7d6e23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:49.666465 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89f71-b9d9-4128-ba8a-9439c7d6e23f admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.666739 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89f71-b9d9-4128-ba8a-9439c7d6e23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.667006 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd89f71-b9d9-4128-ba8a-9439c7d6e23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.667666 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd89f71-b9d9-4128-ba8a-9439c7d6e23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:49.669251 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd89f71-b9d9-4128-ba8a-9439c7d6e23f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:49.679379 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1434/2864] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:49.683239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a4112-8b90-4c45-ba26-97c6f7d1c035 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:49.693419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a4112-8b90-4c45-ba26-97c6f7d1c035 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:49.698435 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda04e4-b03e-4639-b106-a5db926ba695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:49.699030 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda04e4-b03e-4639-b106-a5db926ba695 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.699302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda04e4-b03e-4639-b106-a5db926ba695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.699571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda04e4-b03e-4639-b106-a5db926ba695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.700209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda04e4-b03e-4639-b106-a5db926ba695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:49.701895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda04e4-b03e-4639-b106-a5db926ba695 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:49.712539 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1431/2865] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:49.716713 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd89f71-b9d9-4128-ba8a-9439c7d6e23f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:49.726639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd89f71-b9d9-4128-ba8a-9439c7d6e23f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:49.731519 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e33b54-4c21-4e03-b9d3-e768d896adab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:49.732158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33b54-4c21-4e03-b9d3-e768d896adab admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.732419 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33b54-4c21-4e03-b9d3-e768d896adab admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.732820 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e33b54-4c21-4e03-b9d3-e768d896adab admin admin] PATH_INFO: `/v3/projects/368558aff9e04023a1279ddb1a17ca2c/users/49a324daf12c4f408d8d9d4e3a66d28e/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.747229 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e33b54-4c21-4e03-b9d3-e768d896adab admin admin] RBAC: Authorizing `identity:create_grant(project_id=368558aff9e04023a1279ddb1a17ca2c, user_id=49a324daf12c4f408d8d9d4e3a66d28e, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:49.749934 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e33b54-4c21-4e03-b9d3-e768d896adab admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:49.764535 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1435/2866] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:49 2022] PUT /identity/v3/projects/368558aff9e04023a1279ddb1a17ca2c/users/49a324daf12c4f408d8d9d4e3a66d28e/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:47:49.774970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286332b-08f8-4a6b-9286-ae0f541615e1 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.775252 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286332b-08f8-4a6b-9286-ae0f541615e1 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.775526 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8286332b-08f8-4a6b-9286-ae0f541615e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.804580 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-8286332b-08f8-4a6b-9286-ae0f541615e1 None None] MFA Rules not processed for user `49a324daf12c4f408d8d9d4e3a66d28e`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:49.805780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-8286332b-08f8-4a6b-9286-ae0f541615e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:49.848217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:49.874523 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1432/2867] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:49.879608 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e33b54-4c21-4e03-b9d3-e768d896adab admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:49.926953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:49.946302 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e33b54-4c21-4e03-b9d3-e768d896adab admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:49.951935 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbe74-1b3e-4381-a3ea-e95eee987a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:49.952543 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbe74-1b3e-4381-a3ea-e95eee987a2e admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:49.952821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbe74-1b3e-4381-a3ea-e95eee987a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:49.953089 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2cbe74-1b3e-4381-a3ea-e95eee987a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:49.953781 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cbe74-1b3e-4381-a3ea-e95eee987a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:49.955727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2cbe74-1b3e-4381-a3ea-e95eee987a2e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:49.986445 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1436/2868] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:49 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:49.990490 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286332b-08f8-4a6b-9286-ae0f541615e1 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.001575 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8286332b-08f8-4a6b-9286-ae0f541615e1 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:50.064452 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4eba-547e-4a9c-985b-91f445a49025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:50.065062 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4eba-547e-4a9c-985b-91f445a49025 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.065342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4eba-547e-4a9c-985b-91f445a49025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.065613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f4eba-547e-4a9c-985b-91f445a49025 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.066275 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f4eba-547e-4a9c-985b-91f445a49025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:50.068220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f4eba-547e-4a9c-985b-91f445a49025 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:50.091581 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1433/2869] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:49 2022] POST /identity/v3/users => generated 296 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:50.097281 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbe74-1b3e-4381-a3ea-e95eee987a2e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.108569 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2cbe74-1b3e-4381-a3ea-e95eee987a2e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:50.113827 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20441f-38c3-4194-aa11-b4230f76046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:50.114427 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20441f-38c3-4194-aa11-b4230f76046e admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.114716 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20441f-38c3-4194-aa11-b4230f76046e admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.114980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20441f-38c3-4194-aa11-b4230f76046e admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.115624 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20441f-38c3-4194-aa11-b4230f76046e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:50.117221 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20441f-38c3-4194-aa11-b4230f76046e admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:50.128060 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1437/2870] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:50.132563 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4eba-547e-4a9c-985b-91f445a49025 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.142588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f4eba-547e-4a9c-985b-91f445a49025 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:50.147468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b3413-551f-4671-9c4b-6002b1cc1194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:50.148107 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b3413-551f-4671-9c4b-6002b1cc1194 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.148384 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b3413-551f-4671-9c4b-6002b1cc1194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.148649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b3413-551f-4671-9c4b-6002b1cc1194 admin admin] PATH_INFO: `/v3/projects/0e4643a172e84991bd202b6e615ece6a/users/d9d34952570843be8e85793c48aff3e7/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.163670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b3413-551f-4671-9c4b-6002b1cc1194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4643a172e84991bd202b6e615ece6a, user_id=d9d34952570843be8e85793c48aff3e7, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:50.166402 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b3413-551f-4671-9c4b-6002b1cc1194 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:50.181461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1434/2871] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:50 2022] PUT /identity/v3/projects/0e4643a172e84991bd202b6e615ece6a/users/d9d34952570843be8e85793c48aff3e7/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:50.185387 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20441f-38c3-4194-aa11-b4230f76046e admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.195788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20441f-38c3-4194-aa11-b4230f76046e admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:50.255625 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eabb38-3b5a-45cd-884b-7305d5c1cfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:50.256147 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eabb38-3b5a-45cd-884b-7305d5c1cfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.256430 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eabb38-3b5a-45cd-884b-7305d5c1cfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.256697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eabb38-3b5a-45cd-884b-7305d5c1cfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.257347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eabb38-3b5a-45cd-884b-7305d5c1cfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:50.258977 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eabb38-3b5a-45cd-884b-7305d5c1cfaf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:50.268816 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1438/2872] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:47:50.273282 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b3413-551f-4671-9c4b-6002b1cc1194 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.284199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b3413-551f-4671-9c4b-6002b1cc1194 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:50.290240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:50.290919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.291194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.291461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] PATH_INFO: `/v3/projects/0e4643a172e84991bd202b6e615ece6a/users/d9d34952570843be8e85793c48aff3e7/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.293704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e4643a172e84991bd202b6e615ece6a, user_id=d9d34952570843be8e85793c48aff3e7, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:50.296501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:50.307212 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1435/2873] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:50 2022] PUT /identity/v3/projects/0e4643a172e84991bd202b6e615ece6a/users/d9d34952570843be8e85793c48aff3e7/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:50.372725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a7bd-b45c-43a4-afdd-7d61bff6a24a None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.373003 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a7bd-b45c-43a4-afdd-7d61bff6a24a None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.373328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8a7bd-b45c-43a4-afdd-7d61bff6a24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.403912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-52c8a7bd-b45c-43a4-afdd-7d61bff6a24a None None] MFA Rules not processed for user `d9d34952570843be8e85793c48aff3e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:50.405278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-52c8a7bd-b45c-43a4-afdd-7d61bff6a24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:50.472424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1439/2874] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:50 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:50.485579 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.487666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:50.547150 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd562b-ef3d-459d-94b6-563881d54031 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:50.551001 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37ed84-5ef9-40be-b38d-61231f47718c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:50.551640 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ed84-5ef9-40be-b38d-61231f47718c service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.551910 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ed84-5ef9-40be-b38d-61231f47718c service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.552174 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ed84-5ef9-40be-b38d-61231f47718c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.561367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37ed84-5ef9-40be-b38d-61231f47718c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:50.562844 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37ed84-5ef9-40be-b38d-61231f47718c service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:50.571895 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1436/2875] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:50.897887 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8a7bd-b45c-43a4-afdd-7d61bff6a24a None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.907422 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8a7bd-b45c-43a4-afdd-7d61bff6a24a None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:50.912423 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d34952570843be8e85793c48aff3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4643a172e84991bd202b6e615ece6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:50.913023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.913303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.913576 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.914301 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:47:50.914604 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:50.916203 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:50.927933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1440/2876] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:47:50.932560 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37ed84-5ef9-40be-b38d-61231f47718c service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.942048 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37ed84-5ef9-40be-b38d-61231f47718c service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:50.947899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66d6f-e817-451e-bc62-ce2cabc4036a tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d34952570843be8e85793c48aff3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4643a172e84991bd202b6e615ece6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:50.948501 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66d6f-e817-451e-bc62-ce2cabc4036a tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:50.948781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66d6f-e817-451e-bc62-ce2cabc4036a tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:50.949046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa66d6f-e817-451e-bc62-ce2cabc4036a tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:50.949665 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66d6f-e817-451e-bc62-ce2cabc4036a tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:50.951612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa66d6f-e817-451e-bc62-ce2cabc4036a tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:50.982170 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1437/2877] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:50 2022] POST /identity/v3/projects => generated 354 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:50.986704 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:50.997204 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293a246-f125-4590-9462-7c7348dd58cb tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:51.018962 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:51.057267 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d34952570843be8e85793c48aff3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4643a172e84991bd202b6e615ece6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:51.057901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:51.058185 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:51.058464 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:51.059112 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:47:51.059415 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:51.061037 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:51.072722 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1441/2878] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:47:51.111182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66d6f-e817-451e-bc62-ce2cabc4036a tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:51.123251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa66d6f-e817-451e-bc62-ce2cabc4036a tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:51.130217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d34952570843be8e85793c48aff3e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e4643a172e84991bd202b6e615ece6a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:51.130839 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:51.131119 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:51.131385 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] PATH_INFO: `/v3/projects/e2de477f42ac4a5c915ec52abb79e633` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:51.132740 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e2de477f42ac4a5c915ec52abb79e633)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:51.134698 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:51.146365 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:51.183613 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2de477f42ac4a5c915ec52abb79e633', 'request_id': 'req-f8fa6bff-4a32-4391-9189-981b4bfe0c41'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.189517 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2de477f42ac4a5c915ec52abb79e633', 'request_id': 'req-f8fa6bff-4a32-4391-9189-981b4bfe0c41'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.196553 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2de477f42ac4a5c915ec52abb79e633', 'request_id': 'req-f8fa6bff-4a32-4391-9189-981b4bfe0c41'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.211059 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] The token cache is being invalidate because project e2de477f42ac4a5c915ec52abb79e633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:47:51.211349 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.212015 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-f8fa6bff-4a32-4391-9189-981b4bfe0c41 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.213530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1438/2879] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:47:51 2022] DELETE /identity/v3/projects/e2de477f42ac4a5c915ec52abb79e633 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:51.410406 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:51.412152 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:51.484773 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ccbf1-a3ec-4c87-b872-29867a4420d8 tempest-VolumeQuotaClassesTest-729062876 tempest-VolumeQuotaClassesTest-729062876-project-admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:51.551047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:51.551705 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:51.551986 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:51.552257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] PATH_INFO: `/v3/users/49a324daf12c4f408d8d9d4e3a66d28e` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:51.553443 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a324daf12c4f408d8d9d4e3a66d28e)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:51.555402 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:51.604911 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a324daf12c4f408d8d9d4e3a66d28e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.605627 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a324daf12c4f408d8d9d4e3a66d28e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.613668 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a324daf12c4f408d8d9d4e3a66d28e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.625546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:51.628501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a324daf12c4f408d8d9d4e3a66d28e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.630175 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a324daf12c4f408d8d9d4e3a66d28e'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:51.645526 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1442/2880] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:47:51 2022] DELETE /identity/v3/users/49a324daf12c4f408d8d9d4e3a66d28e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:51.650419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103f01f-9dfe-41f5-8bf9-bbe22a15097b None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:51.650706 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103f01f-9dfe-41f5-8bf9-bbe22a15097b None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:51.650978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103f01f-9dfe-41f5-8bf9-bbe22a15097b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:51.671442 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-e103f01f-9dfe-41f5-8bf9-bbe22a15097b None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:51.672657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e103f01f-9dfe-41f5-8bf9-bbe22a15097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:51.734146 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1439/2881] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:51.744259 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:51.745701 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:51.809307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf03271-6026-40ab-8d78-a70d75a10070 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:51.813506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403354c-0321-45f6-a79f-efe849f72bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:51.814157 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403354c-0321-45f6-a79f-efe849f72bdc service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:51.814432 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403354c-0321-45f6-a79f-efe849f72bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:51.814697 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403354c-0321-45f6-a79f-efe849f72bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:51.825572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403354c-0321-45f6-a79f-efe849f72bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:51.827444 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403354c-0321-45f6-a79f-efe849f72bdc service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:51.838184 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1443/2882] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:52.133834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103f01f-9dfe-41f5-8bf9-bbe22a15097b None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:52.135790 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-e103f01f-9dfe-41f5-8bf9-bbe22a15097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:52.149962 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103f01f-9dfe-41f5-8bf9-bbe22a15097b None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:52.155292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:52.155927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:52.156209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:52.156473 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] PATH_INFO: `/v3/projects/368558aff9e04023a1279ddb1a17ca2c` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:52.157649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=368558aff9e04023a1279ddb1a17ca2c)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:52.159612 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:52.208938 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368558aff9e04023a1279ddb1a17ca2c', 'request_id': 'req-5294957c-5fd4-4de4-a8da-5a42e9496b84'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.214791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368558aff9e04023a1279ddb1a17ca2c', 'request_id': 'req-5294957c-5fd4-4de4-a8da-5a42e9496b84'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.221182 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368558aff9e04023a1279ddb1a17ca2c', 'request_id': 'req-5294957c-5fd4-4de4-a8da-5a42e9496b84'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.235361 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] The token cache is being invalidate because project 368558aff9e04023a1279ddb1a17ca2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:47:52.235645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.236269 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.237809 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1440/2883] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:47:52 2022] DELETE /identity/v3/projects/368558aff9e04023a1279ddb1a17ca2c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:52.242031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403354c-0321-45f6-a79f-efe849f72bdc service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:52.252047 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403354c-0321-45f6-a79f-efe849f72bdc service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:52.313585 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:52.316024 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:52.316344 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:52.316632 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] PATH_INFO: `/v3/users/d9d34952570843be8e85793c48aff3e7` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:52.317873 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d34952570843be8e85793c48aff3e7)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:52.319788 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:52.370372 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d34952570843be8e85793c48aff3e7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.371001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d34952570843be8e85793c48aff3e7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.379990 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d34952570843be8e85793c48aff3e7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.392242 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d34952570843be8e85793c48aff3e7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.392856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-ea89008e-769d-4e97-a721-12b86df674ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d34952570843be8e85793c48aff3e7'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.404939 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1444/2884] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:47:52 2022] DELETE /identity/v3/users/d9d34952570843be8e85793c48aff3e7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:52.700356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:52.702607 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:52.718764 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294957c-5fd4-4de4-a8da-5a42e9496b84 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:52.739625 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:52.782659 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:52.783229 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:52.783508 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:52.783830 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] PATH_INFO: `/v3/projects/0e4643a172e84991bd202b6e615ece6a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:52.785089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e4643a172e84991bd202b6e615ece6a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:52.787093 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:52.840450 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e4643a172e84991bd202b6e615ece6a', 'request_id': 'req-37b0abe5-220b-4dce-b4b0-15c1985010c0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.847836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e4643a172e84991bd202b6e615ece6a', 'request_id': 'req-37b0abe5-220b-4dce-b4b0-15c1985010c0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.856704 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e4643a172e84991bd202b6e615ece6a', 'request_id': 'req-37b0abe5-220b-4dce-b4b0-15c1985010c0'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.873341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] The token cache is being invalidate because project 0e4643a172e84991bd202b6e615ece6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:47:52.873632 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.874356 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-37b0abe5-220b-4dce-b4b0-15c1985010c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:47:52.875942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1441/2885] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:47:52 2022] DELETE /identity/v3/projects/0e4643a172e84991bd202b6e615ece6a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:52.881491 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca404c8-70ca-42ac-a4d1-14b3b3422248 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:52.882007 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca404c8-70ca-42ac-a4d1-14b3b3422248 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:52.882126 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca404c8-70ca-42ac-a4d1-14b3b3422248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:52.896002 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:52.902966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-3ca404c8-70ca-42ac-a4d1-14b3b3422248 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:52.905393 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-3ca404c8-70ca-42ac-a4d1-14b3b3422248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:52.968181 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1445/2886] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:52.976240 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009a78-e704-4385-b187-1f8e3af7d8c3 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:52.976598 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009a78-e704-4385-b187-1f8e3af7d8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:52.976874 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32009a78-e704-4385-b187-1f8e3af7d8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:52.998169 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-32009a78-e704-4385-b187-1f8e3af7d8c3 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:52.999428 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-32009a78-e704-4385-b187-1f8e3af7d8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:53.009285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1442/2887] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:53.014054 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca404c8-70ca-42ac-a4d1-14b3b3422248 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.024065 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca404c8-70ca-42ac-a4d1-14b3b3422248 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.029645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.030413 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.030692 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.030959 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.031645 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81409) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:47:53.031980 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.033633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.046092 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1446/2888] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:47:53.050631 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32009a78-e704-4385-b187-1f8e3af7d8c3 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.060323 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32009a78-e704-4385-b187-1f8e3af7d8c3 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.065942 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83c71-7468-4ad7-8a28-d790fc5a1746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.066541 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83c71-7468-4ad7-8a28-d790fc5a1746 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.066824 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83c71-7468-4ad7-8a28-d790fc5a1746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.067094 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba83c71-7468-4ad7-8a28-d790fc5a1746 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.067724 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba83c71-7468-4ad7-8a28-d790fc5a1746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.069666 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba83c71-7468-4ad7-8a28-d790fc5a1746 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.102751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1443/2889] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:53 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:53.107135 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.117463 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5ac30-43ca-49ef-9266-e49a038fb1ce admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.194996 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad840da-d135-40ce-94dd-ec3166e77b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.195796 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad840da-d135-40ce-94dd-ec3166e77b99 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.196178 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad840da-d135-40ce-94dd-ec3166e77b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.196567 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad840da-d135-40ce-94dd-ec3166e77b99 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.197522 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad840da-d135-40ce-94dd-ec3166e77b99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.199477 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad840da-d135-40ce-94dd-ec3166e77b99 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.226832 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1447/2890] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:53 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:53.231101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83c71-7468-4ad7-8a28-d790fc5a1746 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.242784 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba83c71-7468-4ad7-8a28-d790fc5a1746 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.248657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf6d79-28cf-44e8-9725-2cb69eca5412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.249266 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf6d79-28cf-44e8-9725-2cb69eca5412 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.249545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf6d79-28cf-44e8-9725-2cb69eca5412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.249859 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf6d79-28cf-44e8-9725-2cb69eca5412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.250509 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf6d79-28cf-44e8-9725-2cb69eca5412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.252129 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf6d79-28cf-44e8-9725-2cb69eca5412 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.263272 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1444/2891] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:53.267924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad840da-d135-40ce-94dd-ec3166e77b99 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.279572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad840da-d135-40ce-94dd-ec3166e77b99 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.285164 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1321c-5c48-4d5c-b331-d4529e3ad167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.285707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1321c-5c48-4d5c-b331-d4529e3ad167 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.286011 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1321c-5c48-4d5c-b331-d4529e3ad167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.286273 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1321c-5c48-4d5c-b331-d4529e3ad167 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.286916 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1321c-5c48-4d5c-b331-d4529e3ad167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.288524 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1321c-5c48-4d5c-b331-d4529e3ad167 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.299556 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1448/2892] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:53.303811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf6d79-28cf-44e8-9725-2cb69eca5412 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.314213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf6d79-28cf-44e8-9725-2cb69eca5412 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.319268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9220c-705e-44ba-87fb-60f49cdb8924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.319920 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9220c-705e-44ba-87fb-60f49cdb8924 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.320199 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9220c-705e-44ba-87fb-60f49cdb8924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.320472 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb9220c-705e-44ba-87fb-60f49cdb8924 admin admin] PATH_INFO: `/v3/projects/b5a3e42c03c3438cb856549cb02344bd/users/eeb9d9b6ad494cee9c021bbde73ec038/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.335986 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9220c-705e-44ba-87fb-60f49cdb8924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5a3e42c03c3438cb856549cb02344bd, user_id=eeb9d9b6ad494cee9c021bbde73ec038, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.338818 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb9220c-705e-44ba-87fb-60f49cdb8924 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.354656 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1445/2893] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:53 2022] PUT /identity/v3/projects/b5a3e42c03c3438cb856549cb02344bd/users/eeb9d9b6ad494cee9c021bbde73ec038/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:53.365052 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697df9e-f4ea-4329-88f5-1036194e7bd1 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.365335 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697df9e-f4ea-4329-88f5-1036194e7bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.365601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697df9e-f4ea-4329-88f5-1036194e7bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.395631 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8697df9e-f4ea-4329-88f5-1036194e7bd1 None None] MFA Rules not processed for user `eeb9d9b6ad494cee9c021bbde73ec038`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:53.396833 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8697df9e-f4ea-4329-88f5-1036194e7bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:53.460374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1449/2894] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:53.465350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9220c-705e-44ba-87fb-60f49cdb8924 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.531996 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:53.548887 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb9220c-705e-44ba-87fb-60f49cdb8924 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.555693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1b366-5219-4056-bb9a-eddfbf3b53c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.556578 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b366-5219-4056-bb9a-eddfbf3b53c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.556937 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b366-5219-4056-bb9a-eddfbf3b53c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.557208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f1b366-5219-4056-bb9a-eddfbf3b53c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.558208 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b366-5219-4056-bb9a-eddfbf3b53c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.560894 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f1b366-5219-4056-bb9a-eddfbf3b53c4 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.595898 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1446/2895] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:53 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:53.600276 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697df9e-f4ea-4329-88f5-1036194e7bd1 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.606141 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:53.613727 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697df9e-f4ea-4329-88f5-1036194e7bd1 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.673532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a4de4-2dd4-459a-a2fa-ce6d7869daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.674169 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4de4-2dd4-459a-a2fa-ce6d7869daa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.674442 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4de4-2dd4-459a-a2fa-ce6d7869daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.674714 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a4de4-2dd4-459a-a2fa-ce6d7869daa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.675347 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a4de4-2dd4-459a-a2fa-ce6d7869daa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.677303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a4de4-2dd4-459a-a2fa-ce6d7869daa2 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.704168 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1450/2896] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:53 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:47:53.708595 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1b366-5219-4056-bb9a-eddfbf3b53c4 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.719936 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f1b366-5219-4056-bb9a-eddfbf3b53c4 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.725217 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599f262-5a92-44de-b586-8b7986feff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.725852 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599f262-5a92-44de-b586-8b7986feff4e admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.726194 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599f262-5a92-44de-b586-8b7986feff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.726483 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599f262-5a92-44de-b586-8b7986feff4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.727124 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599f262-5a92-44de-b586-8b7986feff4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.728785 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599f262-5a92-44de-b586-8b7986feff4e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.740027 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1447/2897] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:53.744119 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a4de4-2dd4-459a-a2fa-ce6d7869daa2 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.755121 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a4de4-2dd4-459a-a2fa-ce6d7869daa2 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.761078 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619e044-6a3e-4520-8518-cffdd6f309c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.761662 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e044-6a3e-4520-8518-cffdd6f309c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.761966 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e044-6a3e-4520-8518-cffdd6f309c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.762257 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619e044-6a3e-4520-8518-cffdd6f309c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.762890 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619e044-6a3e-4520-8518-cffdd6f309c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.764476 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619e044-6a3e-4520-8518-cffdd6f309c0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.774595 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1451/2898] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:53.778899 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599f262-5a92-44de-b586-8b7986feff4e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:53.789256 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599f262-5a92-44de-b586-8b7986feff4e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:53.794573 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43796b-d5a1-4b5f-9d55-d0c2c61d1214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:53.795222 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43796b-d5a1-4b5f-9d55-d0c2c61d1214 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.795495 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43796b-d5a1-4b5f-9d55-d0c2c61d1214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.795789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43796b-d5a1-4b5f-9d55-d0c2c61d1214 admin admin] PATH_INFO: `/v3/projects/2a401740f3e14a8faa60954424b26482/users/9ac57eeb65b0454e92037cdb271408c6/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.811913 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43796b-d5a1-4b5f-9d55-d0c2c61d1214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a401740f3e14a8faa60954424b26482, user_id=9ac57eeb65b0454e92037cdb271408c6, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:53.814657 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a43796b-d5a1-4b5f-9d55-d0c2c61d1214 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:53.829303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1448/2899] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:53 2022] PUT /identity/v3/projects/2a401740f3e14a8faa60954424b26482/users/9ac57eeb65b0454e92037cdb271408c6/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:53.840924 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7678ee-c6df-4249-9852-283ea6188701 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:53.841207 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7678ee-c6df-4249-9852-283ea6188701 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:53.841474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7678ee-c6df-4249-9852-283ea6188701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:53.872470 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-8a7678ee-c6df-4249-9852-283ea6188701 None None] MFA Rules not processed for user `9ac57eeb65b0454e92037cdb271408c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:53.873694 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-8a7678ee-c6df-4249-9852-283ea6188701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:53.941064 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1452/2900] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:53.945990 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43796b-d5a1-4b5f-9d55-d0c2c61d1214 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:54.009439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43796b-d5a1-4b5f-9d55-d0c2c61d1214 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:54.014667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1687b-6f24-442f-b793-ad892773199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:54.015269 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1687b-6f24-442f-b793-ad892773199a admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:54.015530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1687b-6f24-442f-b793-ad892773199a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:54.015861 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1687b-6f24-442f-b793-ad892773199a admin admin] PATH_INFO: `/v3/projects` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:54.016503 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1687b-6f24-442f-b793-ad892773199a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:54.018465 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1687b-6f24-442f-b793-ad892773199a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:54.047265 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1449/2901] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:47:53 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:47:54.051485 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7678ee-c6df-4249-9852-283ea6188701 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:54.062374 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7678ee-c6df-4249-9852-283ea6188701 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:54.117572 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d08444-873f-439a-bb7d-f8d34bd786cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:54.118225 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08444-873f-439a-bb7d-f8d34bd786cf admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:54.118479 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08444-873f-439a-bb7d-f8d34bd786cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:54.118742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d08444-873f-439a-bb7d-f8d34bd786cf admin admin] PATH_INFO: `/v3/users` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:54.119377 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d08444-873f-439a-bb7d-f8d34bd786cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:54.121328 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d08444-873f-439a-bb7d-f8d34bd786cf admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:54.139339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:54.147532 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1453/2902] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:47:54 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:47:54.148814 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1687b-6f24-442f-b793-ad892773199a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:54.158865 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1687b-6f24-442f-b793-ad892773199a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:54.163629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc19706-40dc-4393-93e2-55d5c1b98b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:54.164224 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19706-40dc-4393-93e2-55d5c1b98b53 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:54.164498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19706-40dc-4393-93e2-55d5c1b98b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:54.164765 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc19706-40dc-4393-93e2-55d5c1b98b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:54.165393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc19706-40dc-4393-93e2-55d5c1b98b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:54.167020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc19706-40dc-4393-93e2-55d5c1b98b53 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:54.178746 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1450/2903] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:54.182978 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d08444-873f-439a-bb7d-f8d34bd786cf admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:54.192857 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d08444-873f-439a-bb7d-f8d34bd786cf admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:54.197820 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5668-e7b4-47f9-bc70-87be40fb7475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:54.198459 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5668-e7b4-47f9-bc70-87be40fb7475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:54.198752 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5668-e7b4-47f9-bc70-87be40fb7475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:54.199019 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf5668-e7b4-47f9-bc70-87be40fb7475 admin admin] PATH_INFO: `/v3/projects/817d111bfe4a465190aff60e333e78c6/users/93c8e584a9044f72a84a2900d0de6682/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:54.214149 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf5668-e7b4-47f9-bc70-87be40fb7475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=817d111bfe4a465190aff60e333e78c6, user_id=93c8e584a9044f72a84a2900d0de6682, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:54.216795 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf5668-e7b4-47f9-bc70-87be40fb7475 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:54.231081 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1454/2904] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:54 2022] PUT /identity/v3/projects/817d111bfe4a465190aff60e333e78c6/users/93c8e584a9044f72a84a2900d0de6682/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:47:54.235326 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc19706-40dc-4393-93e2-55d5c1b98b53 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:54.245991 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc19706-40dc-4393-93e2-55d5c1b98b53 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:54.305103 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0f9b1-da67-4da3-8409-d39acc0a1a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:54.305708 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f9b1-da67-4da3-8409-d39acc0a1a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:54.306020 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f9b1-da67-4da3-8409-d39acc0a1a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:54.306292 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0f9b1-da67-4da3-8409-d39acc0a1a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:54.306926 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f9b1-da67-4da3-8409-d39acc0a1a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:54.308530 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0f9b1-da67-4da3-8409-d39acc0a1a43 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:54.318919 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1451/2905] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:47:54.323764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5668-e7b4-47f9-bc70-87be40fb7475 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:54.337132 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf5668-e7b4-47f9-bc70-87be40fb7475 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:54.342173 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:54.342822 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:54.343099 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:54.343367 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] PATH_INFO: `/v3/projects/817d111bfe4a465190aff60e333e78c6/users/93c8e584a9044f72a84a2900d0de6682/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:54.345481 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=817d111bfe4a465190aff60e333e78c6, user_id=93c8e584a9044f72a84a2900d0de6682, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:54.348165 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:54.358807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1455/2906] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:47:54 2022] PUT /identity/v3/projects/817d111bfe4a465190aff60e333e78c6/users/93c8e584a9044f72a84a2900d0de6682/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:47:54.369286 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f58ae-665f-4b64-aaae-c15cd3f2462e None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:54.369571 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f58ae-665f-4b64-aaae-c15cd3f2462e None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:54.369870 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f58ae-665f-4b64-aaae-c15cd3f2462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:54.390345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:47:54.399850 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-891f58ae-665f-4b64-aaae-c15cd3f2462e None None] MFA Rules not processed for user `93c8e584a9044f72a84a2900d0de6682`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:47:54.401588 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-891f58ae-665f-4b64-aaae-c15cd3f2462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:54.468641 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1452/2907] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:47:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:47:54.480110 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:54.481901 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:54.551522 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297a673-b41f-4804-9e04-c5885070b32a admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:54.555889 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f2ea-2162-4667-b360-e0709c3077bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:54.556490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f2ea-2162-4667-b360-e0709c3077bb service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:54.556765 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f2ea-2162-4667-b360-e0709c3077bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:54.557031 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7f2ea-2162-4667-b360-e0709c3077bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:54.567062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f2ea-2162-4667-b360-e0709c3077bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:54.568498 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7f2ea-2162-4667-b360-e0709c3077bb service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:54.578871 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1456/2908] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:55.142306 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f58ae-665f-4b64-aaae-c15cd3f2462e None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:55.143975 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-891f58ae-665f-4b64-aaae-c15cd3f2462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:47:55.157297 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f58ae-665f-4b64-aaae-c15cd3f2462e None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:55.162081 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8fcb1-7716-491b-9e92-ec5f8e048d24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:55.162693 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8fcb1-7716-491b-9e92-ec5f8e048d24 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:55.162970 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8fcb1-7716-491b-9e92-ec5f8e048d24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:55.163236 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8fcb1-7716-491b-9e92-ec5f8e048d24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:55.223338 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8fcb1-7716-491b-9e92-ec5f8e048d24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:55.224836 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8fcb1-7716-491b-9e92-ec5f8e048d24 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:55.234331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1453/2909] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:47:59.552581 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f2ea-2162-4667-b360-e0709c3077bb service cinder] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:47:59.561490 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7f2ea-2162-4667-b360-e0709c3077bb service cinder] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:47:59.565338 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25817a0-d92e-4cef-b98f-c8a450599540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:47:59.566017 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25817a0-d92e-4cef-b98f-c8a450599540 service cinder] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:47:59.566239 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25817a0-d92e-4cef-b98f-c8a450599540 service cinder] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:47:59.566505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25817a0-d92e-4cef-b98f-c8a450599540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:47:59.622856 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25817a0-d92e-4cef-b98f-c8a450599540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:47:59.624300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25817a0-d92e-4cef-b98f-c8a450599540 service cinder] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:47:59.633742 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1457/2910] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:47:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:48:01.800471 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8fcb1-7716-491b-9e92-ec5f8e048d24 service cinder] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:01.868089 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8fcb1-7716-491b-9e92-ec5f8e048d24 service cinder] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:01.872711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:01.873341 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:01.873615 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:01.873927 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] PATH_INFO: `/v3/users/eeb9d9b6ad494cee9c021bbde73ec038` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:01.875054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeb9d9b6ad494cee9c021bbde73ec038)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:01.876983 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:01.917687 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:01.927725 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeb9d9b6ad494cee9c021bbde73ec038'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:01.928368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeb9d9b6ad494cee9c021bbde73ec038'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:01.935804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeb9d9b6ad494cee9c021bbde73ec038'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:01.942834 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeb9d9b6ad494cee9c021bbde73ec038'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:01.943448 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeb9d9b6ad494cee9c021bbde73ec038'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:01.960499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1454/2911] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:48:01 2022] DELETE /identity/v3/users/eeb9d9b6ad494cee9c021bbde73ec038 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:01.965279 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd0e8-b72c-41ce-acbe-6e2ac9f6a4c9 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:01.965843 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd0e8-b72c-41ce-acbe-6e2ac9f6a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:01.966036 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52bd0e8-b72c-41ce-acbe-6e2ac9f6a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:01.985958 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-b52bd0e8-b72c-41ce-acbe-6e2ac9f6a4c9 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:48:01.987433 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b52bd0e8-b72c-41ce-acbe-6e2ac9f6a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:02.050643 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1458/2912] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 03:48:02.060789 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:02.062357 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:02.121727 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce489a59-3d20-4f2a-9fb5-1c02178af86e admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:02.126328 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe5223-a938-4bc7-8bda-02d05fa9053b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:02.126935 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe5223-a938-4bc7-8bda-02d05fa9053b service neutron] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:02.127213 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe5223-a938-4bc7-8bda-02d05fa9053b service neutron] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:02.127487 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fe5223-a938-4bc7-8bda-02d05fa9053b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:02.137902 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe5223-a938-4bc7-8bda-02d05fa9053b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:02.139387 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fe5223-a938-4bc7-8bda-02d05fa9053b service neutron] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:02.149251 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1455/2913] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 03:48:02.443150 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd0e8-b72c-41ce-acbe-6e2ac9f6a4c9 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:02.444725 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-b52bd0e8-b72c-41ce-acbe-6e2ac9f6a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:02.454693 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:02.461261 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52bd0e8-b72c-41ce-acbe-6e2ac9f6a4c9 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:02.467083 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:02.468424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:02.469039 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:02.469314 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] PATH_INFO: `/v3/projects/b5a3e42c03c3438cb856549cb02344bd` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:02.470715 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5a3e42c03c3438cb856549cb02344bd)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:02.472506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:02.521472 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5a3e42c03c3438cb856549cb02344bd', 'request_id': 'req-bf10901f-6ba4-4162-a194-7df70eaf3d2d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.527912 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5a3e42c03c3438cb856549cb02344bd', 'request_id': 'req-bf10901f-6ba4-4162-a194-7df70eaf3d2d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.536745 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5a3e42c03c3438cb856549cb02344bd', 'request_id': 'req-bf10901f-6ba4-4162-a194-7df70eaf3d2d'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.547618 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] The token cache is being invalidate because project b5a3e42c03c3438cb856549cb02344bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:48:02.547902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.548531 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.550070 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1459/2914] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:48:02 2022] DELETE /identity/v3/projects/b5a3e42c03c3438cb856549cb02344bd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:48:02.554268 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe5223-a938-4bc7-8bda-02d05fa9053b service neutron] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:02.564277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fe5223-a938-4bc7-8bda-02d05fa9053b service neutron] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:02.629159 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:02.629863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:02.630145 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:02.630436 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] PATH_INFO: `/v3/users/9ac57eeb65b0454e92037cdb271408c6` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:02.631609 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ac57eeb65b0454e92037cdb271408c6)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:02.633587 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:02.681667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ac57eeb65b0454e92037cdb271408c6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.682409 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ac57eeb65b0454e92037cdb271408c6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.691077 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ac57eeb65b0454e92037cdb271408c6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.693599 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:02.705303 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ac57eeb65b0454e92037cdb271408c6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.706545 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ac57eeb65b0454e92037cdb271408c6'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:02.746204 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1456/2915] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:48:02 2022] DELETE /identity/v3/users/9ac57eeb65b0454e92037cdb271408c6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:48:03.045545 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:03.047300 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:03.064263 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10901f-6ba4-4162-a194-7df70eaf3d2d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:03.138303 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:03.138937 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:03.139240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:03.139510 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] PATH_INFO: `/v3/projects/2a401740f3e14a8faa60954424b26482` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:03.140707 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a401740f3e14a8faa60954424b26482)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:03.142672 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:03.195307 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a401740f3e14a8faa60954424b26482', 'request_id': 'req-cec8f89c-3f57-450a-b66f-722a80e42d1f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.202563 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a401740f3e14a8faa60954424b26482', 'request_id': 'req-cec8f89c-3f57-450a-b66f-722a80e42d1f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.212741 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a401740f3e14a8faa60954424b26482', 'request_id': 'req-cec8f89c-3f57-450a-b66f-722a80e42d1f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.229538 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] The token cache is being invalidate because project 2a401740f3e14a8faa60954424b26482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:48:03.229858 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.230501 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.232067 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1460/2916] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:48:03 2022] DELETE /identity/v3/projects/2a401740f3e14a8faa60954424b26482 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:03.236965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:03.238994 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:03.265333 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7233c-4628-4be3-8266-f81c6008c29a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:03.333598 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:03.334439 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:03.334832 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:03.335209 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] PATH_INFO: `/v3/users/93c8e584a9044f72a84a2900d0de6682` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:03.337054 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c8e584a9044f72a84a2900d0de6682)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:03.339244 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:03.391863 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c8e584a9044f72a84a2900d0de6682'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.392838 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c8e584a9044f72a84a2900d0de6682'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.403835 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c8e584a9044f72a84a2900d0de6682'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.411295 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c8e584a9044f72a84a2900d0de6682'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.412046 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-44018852-45d3-45d0-8d48-91e0432f1ec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c8e584a9044f72a84a2900d0de6682'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.432603 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1457/2917] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:48:03 2022] DELETE /identity/v3/users/93c8e584a9044f72a84a2900d0de6682 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:03.726670 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:03.728237 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:03.742162 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8f89c-3f57-450a-b66f-722a80e42d1f admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:03.756717 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:03.805657 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:03.806326 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:03.806601 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:03.806876 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] PATH_INFO: `/v3/projects/817d111bfe4a465190aff60e333e78c6` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:03.808023 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] RBAC: Authorizing `identity:delete_project(project_id=817d111bfe4a465190aff60e333e78c6)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:03.809991 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:03.857240 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '817d111bfe4a465190aff60e333e78c6', 'request_id': 'req-d0ca6fb8-6381-4db8-9fef-e02c5898611f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.864188 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '817d111bfe4a465190aff60e333e78c6', 'request_id': 'req-d0ca6fb8-6381-4db8-9fef-e02c5898611f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.872785 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '817d111bfe4a465190aff60e333e78c6', 'request_id': 'req-d0ca6fb8-6381-4db8-9fef-e02c5898611f'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.884521 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] The token cache is being invalidate because project 817d111bfe4a465190aff60e333e78c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81409) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:48:03.884807 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.885474 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-d0ca6fb8-6381-4db8-9fef-e02c5898611f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:03.887032 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1461/2918] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:48:03 2022] DELETE /identity/v3/projects/817d111bfe4a465190aff60e333e78c6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 03:48:03.893071 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ad783-5a8a-4aaf-b24c-ca3e69ded094 None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:03.893362 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ad783-5a8a-4aaf-b24c-ca3e69ded094 None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:03.893781 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158ad783-5a8a-4aaf-b24c-ca3e69ded094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:03.929488 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-158ad783-5a8a-4aaf-b24c-ca3e69ded094 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:48:03.930928 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-158ad783-5a8a-4aaf-b24c-ca3e69ded094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:03.981125 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:03.997219 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1458/2919] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:48:04.007515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816fab-d078-4e1e-b626-3a88f8a70692 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.007862 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816fab-d078-4e1e-b626-3a88f8a70692 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.008137 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f816fab-d078-4e1e-b626-3a88f8a70692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.030731 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-0f816fab-d078-4e1e-b626-3a88f8a70692 None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:48:04.031960 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-0f816fab-d078-4e1e-b626-3a88f8a70692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:04.040932 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1462/2920] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:48:04.045461 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ad783-5a8a-4aaf-b24c-ca3e69ded094 None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.055971 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158ad783-5a8a-4aaf-b24c-ca3e69ded094 None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.061498 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.062143 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.062422 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.062690 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] PATH_INFO: `/v3/domains` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.063308 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 03:48:04.063609 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.065223 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.077184 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1459/2921] 10.222.0.48 () {58 vars in 1153 bytes} [Sat Sep 17 03:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 03:48:04.081651 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f816fab-d078-4e1e-b626-3a88f8a70692 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.091287 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f816fab-d078-4e1e-b626-3a88f8a70692 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.096578 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464ec89-20d0-45d5-a00e-bc174799508d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.097296 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ec89-20d0-45d5-a00e-bc174799508d admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.097573 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ec89-20d0-45d5-a00e-bc174799508d admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.097872 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d464ec89-20d0-45d5-a00e-bc174799508d admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.098515 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464ec89-20d0-45d5-a00e-bc174799508d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.100424 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d464ec89-20d0-45d5-a00e-bc174799508d admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.129892 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1463/2922] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:48:04 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 03:48:04.134290 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.144722 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebc5294-5eb4-481c-b4df-77e722567322 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.207842 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a1cf6-1a83-41f4-920e-803d3496a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.208667 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a1cf6-1a83-41f4-920e-803d3496a141 admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.209012 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a1cf6-1a83-41f4-920e-803d3496a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.209342 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a1cf6-1a83-41f4-920e-803d3496a141 admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.210294 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a1cf6-1a83-41f4-920e-803d3496a141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.213042 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a1cf6-1a83-41f4-920e-803d3496a141 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.238419 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1460/2923] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:48:04 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:48:04.242674 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464ec89-20d0-45d5-a00e-bc174799508d admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.253339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d464ec89-20d0-45d5-a00e-bc174799508d admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.259629 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c475214-53eb-4877-b0b8-83f4a8afa4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.260231 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475214-53eb-4877-b0b8-83f4a8afa4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.260506 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475214-53eb-4877-b0b8-83f4a8afa4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.260775 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475214-53eb-4877-b0b8-83f4a8afa4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.261416 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c475214-53eb-4877-b0b8-83f4a8afa4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.263082 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c475214-53eb-4877-b0b8-83f4a8afa4b0 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.273609 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1464/2924] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 03:48:04.277827 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a1cf6-1a83-41f4-920e-803d3496a141 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.288345 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a1cf6-1a83-41f4-920e-803d3496a141 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.293873 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea5a1d8-e5c6-49eb-8c7c-c16844dad389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.294477 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a1d8-e5c6-49eb-8c7c-c16844dad389 admin admin] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.294751 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a1d8-e5c6-49eb-8c7c-c16844dad389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.295017 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea5a1d8-e5c6-49eb-8c7c-c16844dad389 admin admin] PATH_INFO: `/v3/roles` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.295685 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5a1d8-e5c6-49eb-8c7c-c16844dad389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.297302 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea5a1d8-e5c6-49eb-8c7c-c16844dad389 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.308670 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1461/2925] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:48:04.312895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c475214-53eb-4877-b0b8-83f4a8afa4b0 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.327041 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c475214-53eb-4877-b0b8-83f4a8afa4b0 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.336915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8d82-f5ce-4451-a6cd-40df673cb862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.337583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8d82-f5ce-4451-a6cd-40df673cb862 admin admin] REQUEST_METHOD: `PUT` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.337888 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8d82-f5ce-4451-a6cd-40df673cb862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.338158 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd8d82-f5ce-4451-a6cd-40df673cb862 admin admin] PATH_INFO: `/v3/projects/a9b7aa05f4194c4ebf1722558fa1693a/users/ba065826d4254ab496cb14015a3f2249/roles/d907003acd2748ac99d722b1aea4288a` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.354841 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd8d82-f5ce-4451-a6cd-40df673cb862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9b7aa05f4194c4ebf1722558fa1693a, user_id=ba065826d4254ab496cb14015a3f2249, role_id=d907003acd2748ac99d722b1aea4288a)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.357518 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd8d82-f5ce-4451-a6cd-40df673cb862 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.371735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1465/2926] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:48:04 2022] PUT /identity/v3/projects/a9b7aa05f4194c4ebf1722558fa1693a/users/ba065826d4254ab496cb14015a3f2249/roles/d907003acd2748ac99d722b1aea4288a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:04.383711 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90799d-2c5e-4a80-a090-966ef2942a0c None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.384025 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90799d-2c5e-4a80-a090-966ef2942a0c None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.384298 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90799d-2c5e-4a80-a090-966ef2942a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.412795 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-1a90799d-2c5e-4a80-a090-966ef2942a0c None None] MFA Rules not processed for user `ba065826d4254ab496cb14015a3f2249`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:48:04.414044 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-1a90799d-2c5e-4a80-a090-966ef2942a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:04.480480 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1462/2927] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:48:04.485308 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8d82-f5ce-4451-a6cd-40df673cb862 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.531933 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:04.556163 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd8d82-f5ce-4451-a6cd-40df673cb862 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.564339 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ac27f-933e-4536-b45b-a8c2543d4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.565352 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac27f-933e-4536-b45b-a8c2543d4c38 admin admin] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.565879 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac27f-933e-4536-b45b-a8c2543d4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.566363 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535ac27f-933e-4536-b45b-a8c2543d4c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.567512 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ac27f-933e-4536-b45b-a8c2543d4c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.571278 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535ac27f-933e-4536-b45b-a8c2543d4c38 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.608122 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1466/2928] 10.222.0.48 () {60 vars in 1153 bytes} [Sat Sep 17 03:48:04 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:48:04.612368 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90799d-2c5e-4a80-a090-966ef2942a0c None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.623712 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90799d-2c5e-4a80-a090-966ef2942a0c None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.672629 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:04.689239 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32278-a42c-4da0-980e-89fbd13b5d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.690195 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32278-a42c-4da0-980e-89fbd13b5d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.690608 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32278-a42c-4da0-980e-89fbd13b5d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.691016 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce32278-a42c-4da0-980e-89fbd13b5d0c admin admin] PATH_INFO: `/v3/users` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.691978 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32278-a42c-4da0-980e-89fbd13b5d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.695061 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce32278-a42c-4da0-980e-89fbd13b5d0c admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.740804 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1463/2929] 10.222.0.48 () {60 vars in 1144 bytes} [Sat Sep 17 03:48:04 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 03:48:04.743898 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ac27f-933e-4536-b45b-a8c2543d4c38 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.755392 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535ac27f-933e-4536-b45b-a8c2543d4c38 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.760499 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b924d8-e267-4768-9de4-2c8abbc23803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.761097 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b924d8-e267-4768-9de4-2c8abbc23803 admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.761373 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b924d8-e267-4768-9de4-2c8abbc23803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.761639 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b924d8-e267-4768-9de4-2c8abbc23803 admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.762318 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b924d8-e267-4768-9de4-2c8abbc23803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.763918 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b924d8-e267-4768-9de4-2c8abbc23803 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.774821 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1467/2930] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:48:04.779082 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32278-a42c-4da0-980e-89fbd13b5d0c admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.795350 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce32278-a42c-4da0-980e-89fbd13b5d0c admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.803090 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77c03b-39b7-4a14-bdf7-d496edccfe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.804192 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77c03b-39b7-4a14-bdf7-d496edccfe80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.804669 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77c03b-39b7-4a14-bdf7-d496edccfe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.805136 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db77c03b-39b7-4a14-bdf7-d496edccfe80 admin admin] PATH_INFO: `/v3/projects/27f966525cf94adf8e3dd651f43bfef3/users/c1b7d6f3c6684d1b875e6738417f9809/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.829730 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77c03b-39b7-4a14-bdf7-d496edccfe80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f966525cf94adf8e3dd651f43bfef3, user_id=c1b7d6f3c6684d1b875e6738417f9809, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.832761 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db77c03b-39b7-4a14-bdf7-d496edccfe80 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.846413 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1464/2931] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:48:04 2022] PUT /identity/v3/projects/27f966525cf94adf8e3dd651f43bfef3/users/c1b7d6f3c6684d1b875e6738417f9809/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:04.851963 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b924d8-e267-4768-9de4-2c8abbc23803 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.865588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b924d8-e267-4768-9de4-2c8abbc23803 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.931234 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ecfbff-8c85-43fc-b48c-646b7b16e1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.931867 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfbff-8c85-43fc-b48c-646b7b16e1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.932253 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfbff-8c85-43fc-b48c-646b7b16e1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.932673 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ecfbff-8c85-43fc-b48c-646b7b16e1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.933315 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecfbff-8c85-43fc-b48c-646b7b16e1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.935069 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ecfbff-8c85-43fc-b48c-646b7b16e1ca admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.945055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1468/2932] 10.222.0.48 () {58 vars in 1122 bytes} [Sat Sep 17 03:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 03:48:04.949499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77c03b-39b7-4a14-bdf7-d496edccfe80 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:04.960277 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db77c03b-39b7-4a14-bdf7-d496edccfe80 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:04.966014 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:04.966676 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] REQUEST_METHOD: `PUT` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.966951 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.967220 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] PATH_INFO: `/v3/projects/27f966525cf94adf8e3dd651f43bfef3/users/c1b7d6f3c6684d1b875e6738417f9809/roles/6288295bacf743c8ad7468f8f1d55674` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:04.969499 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27f966525cf94adf8e3dd651f43bfef3, user_id=c1b7d6f3c6684d1b875e6738417f9809, role_id=6288295bacf743c8ad7468f8f1d55674)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:04.972374 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:04.984324 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1465/2933] 10.222.0.48 () {60 vars in 1483 bytes} [Sat Sep 17 03:48:04 2022] PUT /identity/v3/projects/27f966525cf94adf8e3dd651f43bfef3/users/c1b7d6f3c6684d1b875e6738417f9809/roles/6288295bacf743c8ad7468f8f1d55674 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:04.994902 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76848b-0a98-4a73-888b-ab76ac68f5e7 None None] REQUEST_METHOD: `POST` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:04.995167 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76848b-0a98-4a73-888b-ab76ac68f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:04.995467 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76848b-0a98-4a73-888b-ab76ac68f5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:05.027583 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.auth.core [None req-cf76848b-0a98-4a73-888b-ab76ac68f5e7 None None] MFA Rules not processed for user `c1b7d6f3c6684d1b875e6738417f9809`. Rule list: `[]` (Enabled: `True`). {{(pid=81409) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:48:05.028824 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-cf76848b-0a98-4a73-888b-ab76ac68f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:05.104305 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1469/2934] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:48:05.115999 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:05.118605 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:05.182318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89f5e3-b77d-4ee3-870a-201d9f90c50a admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:05.186183 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af66160-9d85-4c99-af81-b978c9789a89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0cd4b1beb0b149ceba9940a0631f23b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:05.186915 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66160-9d85-4c99-af81-b978c9789a89 service cinder] REQUEST_METHOD: `GET` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:05.187096 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66160-9d85-4c99-af81-b978c9789a89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:05.187367 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af66160-9d85-4c99-af81-b978c9789a89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:05.197079 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af66160-9d85-4c99-af81-b978c9789a89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:05.198649 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af66160-9d85-4c99-af81-b978c9789a89 service cinder] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:05.208053 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1466/2935] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:48:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:48:05.810397 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76848b-0a98-4a73-888b-ab76ac68f5e7 None None] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:05.854327 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:05.875505 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76848b-0a98-4a73-888b-ab76ac68f5e7 None None] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:05.880586 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:05.881212 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:05.881633 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:05.881942 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] PATH_INFO: `/v3/users/ba065826d4254ab496cb14015a3f2249` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:05.883087 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba065826d4254ab496cb14015a3f2249)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:05.885001 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:05.933735 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba065826d4254ab496cb14015a3f2249'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:05.934394 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba065826d4254ab496cb14015a3f2249'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:05.942104 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba065826d4254ab496cb14015a3f2249'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:05.954351 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba065826d4254ab496cb14015a3f2249'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:05.955113 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba065826d4254ab496cb14015a3f2249'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:05.967138 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1470/2936] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:48:05 2022] DELETE /identity/v3/users/ba065826d4254ab496cb14015a3f2249 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:05.971883 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bd5e-8a53-4cca-b73c-005b848bd19a None None] REQUEST_METHOD: `POST` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:05.972468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bd5e-8a53-4cca-b73c-005b848bd19a None None] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:05.972468 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81bd5e-8a53-4cca-b73c-005b848bd19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:05.993123 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.auth.core [None req-fa81bd5e-8a53-4cca-b73c-005b848bd19a None None] MFA Rules not processed for user `b2fd6fa62b8a4cbfaf378f47c21f9783`. Rule list: `[]` (Enabled: `True`). {{(pid=81408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 03:48:05.994393 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fa81bd5e-8a53-4cca-b73c-005b848bd19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:06.058437 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1467/2937] 10.222.0.48 () {58 vars in 958 bytes} [Sat Sep 17 03:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 03:48:06.068915 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:06.070398 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:06.146115 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcfd047-0a6d-4eba-bd2d-8ee2c59bd8d4 admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:06.151042 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff4753-5e33-46fd-862c-590d2496185f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18061b868be44122a849e2e239b56f60', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:06.151878 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff4753-5e33-46fd-862c-590d2496185f service neutron] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:06.152195 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff4753-5e33-46fd-862c-590d2496185f service neutron] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:06.152554 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaff4753-5e33-46fd-862c-590d2496185f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:06.165008 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff4753-5e33-46fd-862c-590d2496185f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:06.167062 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaff4753-5e33-46fd-862c-590d2496185f service neutron] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:06.179968 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1471/2938] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:48:06.494939 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81bd5e-8a53-4cca-b73c-005b848bd19a None None] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:06.496557 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-fa81bd5e-8a53-4cca-b73c-005b848bd19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:06.512855 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81bd5e-8a53-4cca-b73c-005b848bd19a None None] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:06.519122 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:06.519811 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:06.520087 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:06.520354 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] PATH_INFO: `/v3/projects/a9b7aa05f4194c4ebf1722558fa1693a` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:06.521791 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9b7aa05f4194c4ebf1722558fa1693a)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:06.523903 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:06.569965 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:06.579879 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9b7aa05f4194c4ebf1722558fa1693a', 'request_id': 'req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.586780 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9b7aa05f4194c4ebf1722558fa1693a', 'request_id': 'req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.593547 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9b7aa05f4194c4ebf1722558fa1693a', 'request_id': 'req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.609045 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] The token cache is being invalidate because project a9b7aa05f4194c4ebf1722558fa1693a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:48:06.609331 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.609963 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.611441 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1468/2939] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:48:06 2022] DELETE /identity/v3/projects/a9b7aa05f4194c4ebf1722558fa1693a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:06.615774 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff4753-5e33-46fd-862c-590d2496185f service neutron] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:06.625828 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaff4753-5e33-46fd-862c-590d2496185f service neutron] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:06.682972 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:06.683527 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:06.683802 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:06.684080 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] PATH_INFO: `/v3/users/c1b7d6f3c6684d1b875e6738417f9809` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:06.685345 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b7d6f3c6684d1b875e6738417f9809)` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:06.687395 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:06.689895 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:06.738055 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b7d6f3c6684d1b875e6738417f9809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.738859 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b7d6f3c6684d1b875e6738417f9809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.747020 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b7d6f3c6684d1b875e6738417f9809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.761588 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b7d6f3c6684d1b875e6738417f9809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.762274 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.notifications [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b7d6f3c6684d1b875e6738417f9809'} {{(pid=81409) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:06.774546 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1472/2940] 10.222.0.48 () {58 vars in 1224 bytes} [Sat Sep 17 03:48:06 2022] DELETE /identity/v3/users/c1b7d6f3c6684d1b875e6738417f9809 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:07.071671 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] Authenticating user token {{(pid=81408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:48:07.073626 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.fernet_utils [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:48:07.087611 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa3d8f-7b52-420c-b2a6-7c3de7b5f579 admin admin] Validating token access rules against request {{(pid=81408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:48:07.147405 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2fd6fa62b8a4cbfaf378f47c21f9783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04f74c924c074ea694d34911dde51343', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:48:07.148101 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:48:07.148373 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] SCRIPT_NAME: `/identity` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:48:07.148638 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] PATH_INFO: `/v3/projects/27f966525cf94adf8e3dd651f43bfef3` {{(pid=81408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:48:07.149797 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] RBAC: Authorizing `identity:delete_project(project_id=27f966525cf94adf8e3dd651f43bfef3)` {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:48:07.151735 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] RBAC: Authorization granted {{(pid=81408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:48:07.199623 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27f966525cf94adf8e3dd651f43bfef3', 'request_id': 'req-4a704418-186f-4d79-a50b-af18482353af'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:07.205100 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27f966525cf94adf8e3dd651f43bfef3', 'request_id': 'req-4a704418-186f-4d79-a50b-af18482353af'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:07.211285 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27f966525cf94adf8e3dd651f43bfef3', 'request_id': 'req-4a704418-186f-4d79-a50b-af18482353af'} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:07.224714 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] The token cache is being invalidate because project 27f966525cf94adf8e3dd651f43bfef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 03:48:07.225007 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:07.225645 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG keystone.notifications [None req-4a704418-186f-4d79-a50b-af18482353af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 03:48:07.227318 dv-cinder-849143-3-smb devstack@keystone.service[81408]: [pid: 81408|app: 0|req: 1469/2941] 10.222.0.48 () {58 vars in 1233 bytes} [Sat Sep 17 03:48:07 2022] DELETE /identity/v3/projects/27f966525cf94adf8e3dd651f43bfef3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 03:48:16.771193 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:48:17.221527 dv-cinder-849143-3-smb devstack@keystone.service[81408]: DEBUG dbcounter [-] [81408] Writing DB stats keystone:SELECT=61,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 03:50:24.393262 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] Authenticating user token {{(pid=81409) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 03:50:24.394931 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:50:24.472703 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80697432-b9f2-4187-8852-01e0c0710c4b admin admin] Validating token access rules against request {{(pid=81409) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 03:50:24.543764 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402d822-4fb9-481d-9fb2-9ead26fdff39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c7145e2aeb94480da001aa620d1d4ebe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bbefb73feca0406e97651d79e9052cc5', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81409) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 03:50:24.544434 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d822-4fb9-481d-9fb2-9ead26fdff39 service placement] REQUEST_METHOD: `GET` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 03:50:24.544708 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d822-4fb9-481d-9fb2-9ead26fdff39 service placement] SCRIPT_NAME: `/identity` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 03:50:24.544969 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402d822-4fb9-481d-9fb2-9ead26fdff39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81409) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 03:50:24.546926 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.fernet_utils [None req-c402d822-4fb9-481d-9fb2-9ead26fdff39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81409) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 03:50:24.558399 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402d822-4fb9-481d-9fb2-9ead26fdff39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 03:50:24.559976 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402d822-4fb9-481d-9fb2-9ead26fdff39 service placement] RBAC: Authorization granted {{(pid=81409) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 03:50:24.570111 dv-cinder-849143-3-smb devstack@keystone.service[81409]: [pid: 81409|app: 0|req: 1473/2942] 10.222.0.48 () {60 vars in 1365 bytes} [Sat Sep 17 03:50:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 03:50:34.565953 dv-cinder-849143-3-smb devstack@keystone.service[81409]: DEBUG dbcounter [-] [81409] Writing DB stats keystone:SELECT=58 {{(pid=81409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}